Unable to import NTFS disks

[Cephyid]

Per https://doc.freenas.org/9.3/freenas_storage.html#import-disk I have attempted to both import a NTFS disk attached by SATA and a USB drive attached to the USB port. The same problem happens. I can see the file copy doing it's job, it takes forever, but at the end it errors.

I didn't write down the error but I'm pretty sure it was "Reason Import Process was Abruptly Terminated.” and what I'm left with is no files but the entire folder structure. So basically it takes two hours to copy folders over. Why it's so slow is another mystery. Not only is the import disk function incredibly slow but moving files between datasets is painfully slow. So slow that I hesitate to use multiple datasets.

My specs: TS 140 with 20GB of ECC memory and Xeon E3-1225, FreeNAS-9.3-STABLE-201509022158, copying over NTFS volumes

I have a striped 10TB pool setup and have been trying to import to empty datasets. I have a fully functioning pool and dataset that I can copy to over the network but I'm on a 10/100 router and at 11.3MB/s it's very slow moving 6TB of data. I need to get the import disk function working.

Googling I see some references to it not working well in older versions and January of this year seemed to have some problem posts. I see mention of a XHCI driver and Fuse model but I'm very new to this and have no clue what that means. I could use a walk through if there's some additional driver that needs enabling in Freenas or something I've overlooked.

 

[danb35]

I'm on a 10/100 router

Well, there's your problem. Gigabit switches are very cheap (the last 8-port desktop switch I bought was about US$20) and would increase your throughput ten-fold. But of course, that doesn't directly address your problem.

With the information you've provided, I don't think there's any way to say what's going on. The system log should have more details, though. Do any errors appear in /var/log/messages?

 

[Cephyid]

Yeah we're in the process of moving so the PC's are not setup in our own home. Kinda at the mercy of their old router.

Since I'm a rookie how do I access the logs and does it make a difference that the server has been restarted since then?

 

[Cephyid]

[root@freenas ~]# /var/log/messages
bash: /var/log/messages: Permission denied

 

[danb35]

Best answer: ssh to the server, 'cd /var/log', 'tail -50 messages'. You can adjust the -50 to give you more or fewer lines of output.

Less-good answer: use the shell button from the web GUI, then run the same two commands

Yet-less-good answer: At the bottom of the screen in the web GUI you should see a portion with the log messages (in small green print). If not, enable it in System -> Advanced -> Show console messages in the footer. Then, you can click on that portion of the web GUI window to expand it, giving you a larger window to see the last several entries in the log.

The fact that you've rebooted will probably make it harder to find any relevant error messages. For best results, try the import again and then do one of the above once it fails.

Edit: /var/log/messages isn't an executable file, which is why attempting to run it as you did didn't work.

 

[Cephyid]

I logged in with putty but there are no messages going back that far. Let me run another import.

 

[pirateghost]

[root@freenas ~]# /var/log/messages
bash: /var/log/messages: Permission denied

Messages is a log file, not a command. ;)

 

[Cephyid]

This time for simplicity sake all I did was have a 300GB rar file on the drive. It stayed at 31% for a while and errored at just shy of 1 hour. So while I was taking a screenshot and getting the logs I didn't hit the OK button. That last entry of the user terminating the import is after I hit the OK button.

Dialog box:
Import of Volume /dev/ada2s1 Failed.
Reason Import Process was Abruptly Terminated.

Code:

[root@freenas] /var/log# tail -100 messages
Dec  4 17:49:16 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/pdbedit -d 0 -i smbpasswd:/tmp/tmpANKf1N -s /usr/local/etc/smb4.conf -e tdbsam:/var/etc/private/passdb.tdb
Dec  4 17:49:16 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/smbpasswd -e 'daniel'
Dec  4 17:49:16 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/smbpasswd -e 'eliana'
Dec  4 17:49:16 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/smbpasswd -e 'root'
Dec  4 17:49:16 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/bin/getent passwd 'eliana'
Dec  4 17:49:16 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/bin/getent passwd 'daniel'
Dec  4 17:49:16 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/pdbedit -L
Dec  4 17:49:16 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/net sam rights grant root SeTakeOwnershipPrivilege SeBackupPrivilege SeRestorePrivilege
Dec  4 17:49:16 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/net sam rights grant daniel SeTakeOwnershipPrivilege SeBackupPrivilege SeRestorePrivilege
Dec  4 17:49:16 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/net sam rights grant eliana SeTakeOwnershipPrivilege SeBackupPrivilege SeRestorePrivilege
Dec  4 17:49:16 freenas notifier: Importing account for daniel...ok
Dec  4 17:49:16 freenas notifier: Importing account for eliana...ok
Dec  4 17:49:16 freenas notifier: Importing account for root...ok
Dec  4 17:49:16 freenas notifier: Enabled user daniel.
Dec  4 17:49:16 freenas notifier: Enabled user eliana.
Dec  4 17:49:16 freenas notifier: Enabled user root.
Dec  4 17:49:16 freenas notifier: Granted SeTakeOwnershipPrivilege to FREENAS\root
Dec  4 17:49:16 freenas notifier: Granted SeBackupPrivilege to FREENAS\root
Dec  4 17:49:16 freenas notifier: Granted SeRestorePrivilege to FREENAS\root
Dec  4 17:49:16 freenas notifier: Granted SeTakeOwnershipPrivilege to FREENAS\daniel
Dec  4 17:49:16 freenas notifier: Granted SeBackupPrivilege to FREENAS\daniel
Dec  4 17:49:16 freenas notifier: Granted SeRestorePrivilege to FREENAS\daniel
Dec  4 17:49:16 freenas notifier: Granted SeTakeOwnershipPrivilege to FREENAS\eliana
Dec  4 17:49:16 freenas notifier: Granted SeBackupPrivilege to FREENAS\eliana
Dec  4 17:49:16 freenas notifier: Granted SeRestorePrivilege to FREENAS\eliana
Dec  4 17:49:16 freenas notifier: Performing sanity check on Samba configuration: OK
Dec  4 17:49:16 freenas notifier: Reloading nmbd.
Dec  4 17:49:16 freenas nmbd[2354]:   STATUS=daemon 'nmbd' finished starting up and ready to serve connectionsdump_workgroups()
Dec  4 17:49:16 freenas nmbd[2354]:    dump workgroup on subnet    192.168.0.12: netmask=  255.255.255.0:
Dec  4 17:49:16 freenas nmbd[2354]:     WORKGROUP(1) current master browser = DESKTOP-9E72JK4
Dec  4 17:49:16 freenas nmbd[2354]:             FREENAS 40819a23 (FreeNAS Server)
Dec  4 17:49:16 freenas nmbd[2354]:             DESKTOP-9E72JK4 40051003 ()
Dec  4 17:49:16 freenas notifier: Reloading smbd.
Dec  4 17:49:16 freenas notifier: Reloading winbindd.
Dec  4 17:49:16 freenas notifier: Stopping mdnsd.
Dec  4 17:49:16 freenas smbd[2357]: dnssd_clientstub DNSServiceProcessResult called with DNSServiceRef with no ProcessReply function
Dec  4 17:49:16 freenas notifier: Waiting for PIDS: 2516.
Dec  4 17:49:16 freenas notifier: Starting mdnsd.
Dec  4 17:49:35 freenas manage.py: [common.pipesubr:71] Popen()ing: zfs list -H -o mountpoint,name
Dec  4 17:49:36 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/net getlocalsid
Dec  4 17:49:37 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /sbin/sysctl -n 'kern.maxfilesperproc'
Dec  4 17:49:37 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: zfs list -H -o mountpoint
Dec  4 17:49:37 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: zfs list -H -o mountpoint
Dec  4 17:49:37 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: zfs list -H -o mountpoint
Dec  4 17:49:37 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/net getlocalsid
Dec  4 17:49:37 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/pdbedit -d 0 -i smbpasswd:/tmp/tmp0PMX3s -s /usr/local/etc/smb4.conf -e tdbsam:/var/etc/private/passdb.tdb
Dec  4 17:49:37 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/smbpasswd -e 'daniel'
Dec  4 17:49:37 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/smbpasswd -e 'eliana'
Dec  4 17:49:37 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/smbpasswd -e 'root'
Dec  4 17:49:37 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/bin/getent passwd 'eliana'
Dec  4 17:49:37 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/bin/getent passwd 'daniel'
Dec  4 17:49:37 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/pdbedit -L
Dec  4 17:49:37 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/net sam rights grant root SeTakeOwnershipPrivilege SeBackupPrivilege SeRestorePrivilege
Dec  4 17:49:37 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/net sam rights grant daniel SeTakeOwnershipPrivilege SeBackupPrivilege SeRestorePrivilege
Dec  4 17:49:37 freenas generate_smb4_conf.py: [common.pipesubr:71] Popen()ing: /usr/local/bin/net sam rights grant eliana SeTakeOwnershipPrivilege SeBackupPrivilege SeRestorePrivilege
Dec  4 17:49:37 freenas notifier: Importing account for daniel...ok
Dec  4 17:49:37 freenas notifier: Importing account for eliana...ok
Dec  4 17:49:37 freenas notifier: Importing account for root...ok
Dec  4 17:49:37 freenas notifier: Enabled user daniel.
Dec  4 17:49:37 freenas notifier: Enabled user eliana.
Dec  4 17:49:37 freenas notifier: Enabled user root.
Dec  4 17:49:37 freenas notifier: Granted SeTakeOwnershipPrivilege to FREENAS\root
Dec  4 17:49:37 freenas notifier: Granted SeBackupPrivilege to FREENAS\root
Dec  4 17:49:37 freenas notifier: Granted SeRestorePrivilege to FREENAS\root
Dec  4 17:49:37 freenas notifier: Granted SeTakeOwnershipPrivilege to FREENAS\daniel
Dec  4 17:49:37 freenas notifier: Granted SeBackupPrivilege to FREENAS\daniel
Dec  4 17:49:37 freenas notifier: Granted SeRestorePrivilege to FREENAS\daniel
Dec  4 17:49:37 freenas notifier: Granted SeTakeOwnershipPrivilege to FREENAS\eliana
Dec  4 17:49:37 freenas notifier: Granted SeBackupPrivilege to FREENAS\eliana
Dec  4 17:49:37 freenas notifier: Granted SeRestorePrivilege to FREENAS\eliana
Dec  4 17:49:37 freenas notifier: Performing sanity check on Samba configuration: OK
Dec  4 17:49:37 freenas notifier: Reloading nmbd.
Dec  4 17:49:37 freenas nmbd[2354]: [2015/12/04 17:49:37.517797,  0] ../source3/nmbd/nmbd_workgroupdb.c:276(dump_workgroups)
Dec  4 17:49:37 freenas nmbd[2354]:   dump_workgroups()
Dec  4 17:49:37 freenas nmbd[2354]:    dump workgroup on subnet    192.168.0.12: netmask=  255.255.255.0:
Dec  4 17:49:37 freenas nmbd[2354]:     WORKGROUP(1) current master browser = DESKTOP-9E72JK4
Dec  4 17:49:37 freenas nmbd[2354]:             FREENAS 40819a23 (FreeNAS Server)
Dec  4 17:49:37 freenas nmbd[2354]:             DESKTOP-9E72JK4 40051003 ()
Dec  4 17:49:37 freenas notifier: Reloading smbd.
Dec  4 17:49:37 freenas notifier: Reloading winbindd.
Dec  4 17:49:37 freenas notifier: Stopping mdnsd.
Dec  4 17:49:37 freenas notifier: Waiting for PIDS: 4462.
Dec  4 17:49:37 freenas notifier: Starting mdnsd.
Dec  4 17:50:19 freenas smbd[5055]:   STATUS=daemon 'smbd' finished starting up and ready to serve connectionsmatchname: host name/name mismatch: 192.168.0.9 != (NULL)
Dec  4 17:50:19 freenas smbd[5055]: [2015/12/04 17:50:19.611110,  0] ../source3/lib/util_sock.c:1199(get_remote_hostname)
Dec  4 17:50:19 freenas smbd[5055]:   matchname failed on 192.168.0.9
Dec  4 17:50:35 freenas smbd[5071]:   STATUS=daemon 'smbd' finished starting up and ready to serve connectionsmatchname: host name/name mismatch: 192.168.0.9 != (NULL)
Dec  4 17:50:35 freenas smbd[5071]: [2015/12/04 17:50:35.503110,  0] ../source3/lib/util_sock.c:1199(get_remote_hostname)
Dec  4 17:50:35 freenas smbd[5071]:   matchname failed on 192.168.0.9
Dec  4 17:50:56 freenas smbd[5073]:   STATUS=daemon 'smbd' finished starting up and ready to serve connectionsmatchname: host name/name mismatch: 192.168.0.9 != (NULL)
Dec  4 17:50:56 freenas smbd[5073]: [2015/12/04 17:50:56.416099,  0] ../source3/lib/util_sock.c:1199(get_remote_hostname)
Dec  4 17:50:56 freenas smbd[5073]:   matchname failed on 192.168.0.9
Dec  4 18:10:42 freenas fuse-freebsd: version 0.4.4, FUSE ABI 7.8
Dec  4 18:10:42 freenas ntfs-3g[5608]: Version 2014.2.15 external FUSE 29
Dec  4 18:10:42 freenas ntfs-3g[5608]: Mounted /dev/ada2s1 (Read-Only, label "Eliana Backup", NTFS 3.1)
Dec  4 18:10:42 freenas ntfs-3g[5608]: Cmdline options: ro
Dec  4 18:10:42 freenas ntfs-3g[5608]: Mount options: ro,allow_other,nonempty,relatime,fsname=/dev/ada2s1
Dec  4 18:10:42 freenas ntfs-3g[5608]: Ownership and permissions disabled, configuration type 1
Dec  4 19:02:04 freenas ntfs-3g[5608]: Unmounting /dev/ada2s1 (Eliana Backup)
Dec  4 19:10:31 freenas sockscopy: User Terminated Import of Volume: /dev/ada2s1

 

[Cephyid]

I've ordered a gigabit switch but if anyone knows what my main problem is that would help. I still have around 5TB to transfer.