iSCSI Partition randomly crashed

[lohmag]

Hello everyone!
I have FreeNAS with 2 pools connecnted ro Win2008R2 by iSCSI as 2 hard drives. All worked fine but yesterday one partition crashed and now I dont know what to do!
Windows show this partition as raw hard disk
A LOT of Event 51 errors in Event log
Errors in Freenas Log

Show : Freenas log

Jul 6 22:39:25 freenas.stargate.lan istgt[2986]: LOGICAL_UNIT_RESET
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6665:istgt_iscsi_drop_all_conns: ***WARNING*** drop all connections iqn.2011-03.org.example.istgt:iscsi1 by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032817), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032818), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032819), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032820), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032821), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032822), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032823), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032824), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032825), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032826), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032827), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032828), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032829), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032830), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032831), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032832), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032833), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032834), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032835), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032836), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032837), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032838), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032839), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032840), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032841), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032842), OP=0x8a, ElapsedTime=93 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032843), OP=0x8a, ElapsedTime=92 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032844), OP=0x8a, ElapsedTime=87 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032845), OP=0x8a, ElapsedTime=80 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032846), OP=0x8a, ElapsedTime=73 cleared
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: CmdSN(254032816), OP=0x8a, ElapsedTime=93 aborted
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:5318:istgt_lu_disk_queue_start: ***WARNING*** transfer abort CmdSN=254032816
Jul 6 22:39:38 freenas.stargate.lan istgt[2986]: istgt_lu.c:3255:luworker: ***WARNING*** LU2: lu_disk_queue_start() aborted
Jul 6 22:40:09 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6749:istgt_iscsi_drop_old_conns: ***WARNING*** drop old connections iqn.2011-03.org.example.istgt:iscsi1 by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001
Jul 6 22:40:09 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6770:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=1, CID=1
Jul 6 22:40:23 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6816:istgt_iscsi_drop_old_conns: ***WARNING*** exiting 1 conns
Jul 6 22:40:48 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6749:istgt_iscsi_drop_old_conns: ***WARNING*** drop old connections iqn.2011-03.org.example.istgt:iscsi1 by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001
Jul 6 22:40:48 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6770:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=1, CID=1
Jul 6 22:40:48 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6775:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=xx, CID=0
Jul 6 22:40:49 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6816:istgt_iscsi_drop_old_conns: ***WARNING*** exiting 2 conns
Jul 6 22:41:23 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6749:istgt_iscsi_drop_old_conns: ***WARNING*** drop old connections iqn.2011-03.org.example.istgt:iscsi1 by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001
Jul 6 22:41:23 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6770:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=1, CID=1
Jul 6 22:41:23 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6775:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=xx, CID=0
Jul 6 22:41:23 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6775:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=xx, CID=0
Jul 6 22:41:24 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6816:istgt_iscsi_drop_old_conns: ***WARNING*** exiting 3 conns
Jul 6 22:41:57 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6749:istgt_iscsi_drop_old_conns: ***WARNING*** drop old connections iqn.2011-03.org.example.istgt:iscsi1 by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001
Jul 6 22:41:57 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6770:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=1, CID=1
Jul 6 22:41:57 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6775:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=xx, CID=0
Jul 6 22:41:57 freenas.stargate.lan last message repeated 2 times
Jul 6 22:41:58 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6816:istgt_iscsi_drop_old_conns: ***WARNING*** exiting 4 conns
Jul 6 22:42:32 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6749:istgt_iscsi_drop_old_conns: ***WARNING*** drop old connections iqn.2011-03.org.example.istgt:iscsi1 by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001
Jul 6 22:42:32 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6770:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=1, CID=1
Jul 6 22:42:32 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6775:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=xx, CID=0
Jul 6 22:42:32 freenas.stargate.lan last message repeated 3 times
Jul 6 22:42:33 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6816:istgt_iscsi_drop_old_conns: ***WARNING*** exiting 5 conns
Jul 6 22:43:07 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6749:istgt_iscsi_drop_old_conns: ***WARNING*** drop old connections iqn.2011-03.org.example.istgt:iscsi1 by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001
Jul 6 22:43:07 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6770:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=1, CID=1
Jul 6 22:43:07 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6775:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=xx, CID=0
Jul 6 22:43:07 freenas.stargate.lan last message repeated 4 times
Jul 6 22:43:11 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6816:istgt_iscsi_drop_old_conns: ***WARNING*** exiting 6 conns
Jul 6 22:43:42 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6749:istgt_iscsi_drop_old_conns: ***WARNING*** drop old connections iqn.2011-03.org.example.istgt:iscsi1 by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001
Jul 6 22:43:42 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6770:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=1, CID=1
Jul 6 22:43:42 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6775:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=xx, CID=0
Jul 6 22:43:42 freenas.stargate.lan last message repeated 5 times
Jul 6 22:43:43 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6816:istgt_iscsi_drop_old_conns: ***WARNING*** exiting 7 conns
Jul 6 22:44:17 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6749:istgt_iscsi_drop_old_conns: ***WARNING*** drop old connections iqn.2011-03.org.example.istgt:iscsi1 by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001
Jul 6 22:44:17 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6770:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=1, CID=1
Jul 6 22:44:17 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6775:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=xx, CID=0
Jul 6 22:44:17 freenas.stargate.lan last message repeated 6 times
Jul 6 22:44:18 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6816:istgt_iscsi_drop_old_conns: ***WARNING*** exiting 8 conns
Jul 6 22:44:52 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6749:istgt_iscsi_drop_old_conns: ***WARNING*** drop old connections iqn.2011-03.org.example.istgt:iscsi1 by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001
Jul 6 22:44:52 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6770:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=1, CID=1
Jul 6 22:44:52 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6775:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=xx, CID=0
Jul 6 22:44:52 freenas.stargate.lan last message repeated 7 times
Jul 6 22:44:53 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6816:istgt_iscsi_drop_old_conns: ***WARNING*** exiting 9 conns
Jul 6 22:45:27 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6749:istgt_iscsi_drop_old_conns: ***WARNING*** drop old connections iqn.2011-03.org.example.istgt:iscsi1 by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001
Jul 6 22:45:27 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6770:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=1, CID=1
Jul 6 22:45:27 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6775:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=xx, CID=0
Jul 6 22:45:27 freenas.stargate.lan last message repeated 8 times
Jul 6 22:45:28 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6799:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=1, CID=1
Jul 6 22:45:28 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6804:istgt_iscsi_drop_old_conns: ***WARNING*** exiting conn by iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001(192.168.1.112), TSIH=xx, CID=0
Jul 6 22:45:28 freenas.stargate.lan last message repeated 8 times
Jul 6 22:45:28 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:6816:istgt_iscsi_drop_old_conns: ***WARNING*** exiting 10 conns
Jul 6 22:45:35 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:5270:worker_cleanup: ***WARNING*** force cleanup execute
Jul 6 22:45:35 freenas.stargate.lan last message repeated 7 times
Jul 6 22:45:35 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:1261:istgt_iscsi_write_pdu_internal: ***ERROR*** writev() failed (errno=32,iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,time=0)
Jul 6 22:45:35 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:5414:sender: ***ERROR*** iscsi_write_pdu() failed on iqn.2011-03.org.example.istgt:iscsi1,t,0x0001(iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001)
Jul 6 22:45:35 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:1261:istgt_iscsi_write_pdu_internal: ***ERROR*** writev() failed (errno=32,iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,time=0)
Jul 6 22:45:35 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:3924:istgt_iscsi_task_response: ***ERROR*** iscsi_write_pdu() failed
Jul 6 22:45:35 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:5392:sender: ***ERROR*** iscsi_task_response() CmdSN=254032815 failed on iqn.2011-03.org.example.istgt:iscsi1,t,0x0001(iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan,i,0x400001370001)
Jul 6 22:45:35 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:5270:worker_cleanup: ***WARNING*** force cleanup execute
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_iscsi.c:5270:worker_cleanup: ***WARNING*** force cleanup execute
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: Login from iqn.1991-05.com.microsoft:srv2-dc-new.stargate.lan (192.168.1.112) on iqn.2011-03.org.example.istgt:iscsi1 LU2 (192.168.1.111:3260,1), ISID=400001370001, TSIH=2, CID=1, HeaderDigest=off, DataDigest=off
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan last message repeated 6 times
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan last message repeated 4 times
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:4053:istgt_lu_disk_lbread: ***ERROR*** lu_disk_seek() failed
Jul 6 22:45:36 freenas.stargate.lan istgt[2986]: istgt_lu_disk.c:6168:istgt_lu_disk_execute: ***ERROR*** lu_disk_lbread() failed

Show : zpool status

zpool status
pool: VOL1
state: ONLINE
scan: scrub in progress since Tue Jul 7 13:46:58 2015
94.5G scanned out of 22.8T at 66.5M/s, 99h26m to go
0 repaired, 0.40% done
config:

NAME STATE READ WRITE CKSUM
VOL1 ONLINE 0 0 0
raidz2-0 ONLINE 0 0 0
gptid/03b72c28-901b-11e3-82f3-00259092d588 ONLINE 0 0 0
gptid/72c62bf5-ac47-11e4-a7a9-00259092d588 ONLINE 0 0 0
gptid/14dbd626-5cc4-11e3-a517-00259092d588 ONLINE 0 0 0
gptid/1613ea0c-5cc4-11e3-a517-00259092d588 ONLINE 0 0 0
gptid/1755765f-5cc4-11e3-a517-00259092d588 ONLINE 0 0 0
gptid/189c38ca-5cc4-11e3-a517-00259092d588 ONLINE 0 0 0
gptid/19e3567c-5cc4-11e3-a517-00259092d588 ONLINE 0 0 0
gptid/8f433885-f899-11e4-adc3-00259092d588 ONLINE 0 0 0
gptid/1c7cf642-5cc4-11e3-a517-00259092d588 ONLINE 0 0 0
gptid/11708f6a-fe07-11e4-9321-00259092d588 ONLINE 0 0 0

errors: No known data errors

pool: VOL2
state: ONLINE
scan: scrub repaired 16K in 54h52m with 0 errors on Tue Jun 2 06:52:42 2015
config:

NAME STATE READ WRITE CKSUM
VOL2 ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
gptid/bcecf03c-aae9-11e4-9588-00259092d588 ONLINE 0 0 0
gptid/e866079a-5daf-11e3-b993-00259092d588 ONLINE 0 0 0
gptid/e9ce7e4e-5daf-11e3-b993-00259092d588 ONLINE 0 0 0
gptid/eb45b035-5daf-11e3-b993-00259092d588 ONLINE 0 0 0
gptid/ecb11014-5daf-11e3-b993-00259092d588 ONLINE 0 0 0

errors: No known data errors

It shows that all fine but it isnt what can I do? This data is super important!

 

[zambanini]

if it is so super important, post your hardware details ; ) freenas version and more details. for example your snapshot plan

 

[lohmag]

Snapshots is turned off.
System Information
Hostname freenas.stargate.lan Edit
Build FreeNAS-9.2.1.7-RELEASE-x64 (fdbe9a0)
Platform Intel(R) Atom(TM) CPU D525 @ 1.80GHz
Memory 4074MB

 

[lohmag]

Why do you think it broke?

 

[cyberjock]

Can you post a debug file? System -> Advanced -> Save Debug

 

[lohmag]

;

 

[cyberjock]

Well, if you want some tough love.. keep reading.

You don't even have the minimum RAM for FreeNAS. The minimum is 8GB, and you have 1/2 of that. Can't say I'm surprised that things aren't going well.

You have 40+TB of disk space. The thumbrule is 1GB of RAM per TB of disk space, so you should have something like 32GB of RAM, at the minimum.

We already know that when you don't have enough RAM there are performance and reliability problems, and sometimes even lost data and corruption. So I think that answers the question of what happened. You do need to respec your machine to something more reasonable for your storage needs.

I really do hate threads like this one though. I have no doubt that someone did what they did with underspeccing the box in the name of saving money. Well, that money saved is now time and data lost. I'm betting that whoever (or whatever business) just lost their data is probably wishing they had spent the extra $500 or so when they built the system so they could have their data right now. Atoms are not appropriate for business servers. We see this regularly around here. Nobody wants to spend the money, but it often turns into a trade-off... either you spend the money or you may lose your data.

For data that is "super important" some really serious mistakes have been made with regards to the hardware chosen. There may be software configuration errors at work too. I wouldn't be surprised considering the glaring mistakes made with the hardware chosen. :/

At this point the data is almost certainly gone for good. The best recommendation I can make is to go get better hardware and restore from backup, assuming that backups exist. If no backups exist, then your option is to upgrade the server so it doesn't eat more data and contact a company like Ontrack data recovery and see if they can recover anything. But I wouldn't go trying to recover anything until you upgrade your server first. You don't need to compound the problem with more problems because of the inadequate hardware.

Good luck.

 

[cyberjock]

Look like we even warned you about this a while back... https://forums.freenas.org/index.php?threads/cant-remove-device-from-my-volume.16604/#post-85595

 

[lohmag]

I just have started one of the windows restore programs on this raw disk, will see what it can do.

 

[cyberjock]

So not gonna do the upgrade first eh? Well... good luck to you.

 

[lohmag]

I can't upgrade it, my motherboard dont support more than 4gb RAM. To upgrade i should buy new one.

 

[titan_rw]

Lots of your hard drives are having problems too:

Code:

Jul  7 14:05:24 freenas smartd[3190]: Device: /dev/da1 [SAT], 32 Currently unreadable (pending) sectors
Jul  7 14:05:24 freenas smartd[3190]: Device: /dev/da1 [SAT], 32 Offline uncorrectable sectors
Jul  7 14:05:25 freenas smartd[3190]: Device: /dev/da14 [SAT], 448 Currently unreadable (pending) sectors
Jul  7 14:05:25 freenas smartd[3190]: Device: /dev/da14 [SAT], 448 Offline uncorrectable sectors
Jul  7 14:05:25 freenas smartd[3190]: Device: /dev/da2 [SAT], 8 Currently unreadable (pending) sectors
Jul  7 14:05:25 freenas smartd[3190]: Device: /dev/da2 [SAT], 8 Offline uncorrectable sectors
Jul  7 14:05:26 freenas smartd[3190]: Device: /dev/da4 [SAT], 40 Currently unreadable (pending) sectors
Jul  7 14:05:26 freenas smartd[3190]: Device: /dev/da4 [SAT], 40 Offline uncorrectable sectors
Jul  7 14:05:26 freenas smartd[3190]: Device: /dev/da5 [SAT], 8 Currently unreadable (pending) sectors
Jul  7 14:05:26 freenas smartd[3190]: Device: /dev/da5 [SAT], 8 Offline uncorrectable sectors
Jul  7 14:05:27 freenas smartd[3190]: Device: /dev/da6 [SAT], 104 Currently unreadable (pending) sectors
Jul  7 14:05:27 freenas smartd[3190]: Device: /dev/da6 [SAT], 104 Offline uncorrectable sectors
Jul  7 14:05:27 freenas smartd[3190]: Device: /dev/da6 [SAT], previous self-test completed with error (read test element)
Jul  7 14:05:27 freenas smartd[3190]: Device: /dev/da8 [SAT], 24 Currently unreadable (pending) sectors
Jul  7 14:05:27 freenas smartd[3190]: Device: /dev/da8 [SAT], 24 Offline uncorrectable sectors

You should have been getting emails on these. If email was setup properly that is.

I can't believe a 40T system was even remotely working on 4G ram. Amazing.

Anyway, not wanting to replace the MB in order to keep your data safe tells me the data is not that important anyway.

 

[mattbbpl]

I can't believe a 40T system was even remotely working on 4G ram. Amazing.

It may not be QUITE as ridiculous as it sounds. This is from release 9.2. Isn't it possible that the machine is using UFS? (I can't view the log file from here, so perhaps that's already been ruled out by that attachment).

 

[pirateghost]

It may not be QUITE as ridiculous as it sounds. This is from release 9.2. Isn't it possible that the machine is using UFS? (I can't view the log file from here, so perhaps that's already been ruled out by that attachment).

Tap the spoiler button in the first post.

It's zfs...

 

[SweetAndLow]

If this is for a business I'd be looking for a new job even if you don't lose yours from negligence. I can't believe everyone told you it wasn't going to work and you did it anyways and now you're data is probably gone.

So much wrong with this it almost seems fake.

 

[mattbbpl]

Tap the spoiler button in the first post.

It's zfs...

Well, frankly, I'm impressed.

 

[Ericloewe]

Well, frankly, I'm impressed.

What impresses me most is the willingness to pay for Windows Server 2k8 R2 but not for proper hardware for the mass storage...

 

[pirateghost]

What impresses me most is the willingness to pay for Windows Server 2k8 R2 but not for proper hardware for the mass storage...

That hasn't been proven.

Based on what I've seen here, it wouldn't surprise me to learn they are using a pirated copy

 

[Ericloewe]

That hasn't been proven.

Based on what I've seen here, it wouldn't surprise me to learn they are using a pirated copy

That, of course, is highly likely.

 

[Darren Myers]

My word....this is a mild train wreck....some motherboard upgrade should be done, i'd hate to see any more errors come up or just general issues.