Volume degraded after fresh FreeNAS install

Status
Not open for further replies.
M

michaelkoehler

Dabbler
Joined
Jul 8, 2014
Messages
17
So,

I decided to do a fresh install of FreeNAS. I had mirrored boot USB drives (I'll call them A & B). I did the fresh install to A while putting aside B. When I booted up on A, the wizard failed, and my imported volume has degraded status. I shut down and switched to drive B. It booted up fine (aside from an error that one of the boot drive mirrors was gone). I switched back to USB B and my volume is still degraded. I re-installed to B and got the same results.

Below is what I'm getting. I figured I'd seek help here before I screw anything up. Thank you very much for any help you can provide this noob!

Code:
The volume Volume1 (ZFS) state is DEGRADED: One or more devices could not be opened. Sufficient replicas exist for the pool to continue functioning in a degraded state.


Code:
[root@freenas ~]# zpool status -v   
  pool: Volume1   
 state: DEGRADED   
status: One or more devices could not be opened.  Sufficient replicas exist for   
  the pool to continue functioning in a degraded state.   
action: Attach the missing device and online it using 'zpool online'.   
  see: http://illumos.org/msg/ZFS-8000-2Q   
  scan: resilvered 1.45M in 0h0m with 0 errors on Tue Nov 22 16:16:19 2016   
config:   
   
  NAME  STATE  READ WRITE CKSUM   
  Volume1  DEGRADED  0  0  0   
  raidz2-0  DEGRADED  0  0  0   
  14832705343754642082  UNAVAIL  0  0  0  was /dev/gptid/b50fa5a7-7a0f-11e6-97b0-d05099c12
04b.eli   
  gptid/d2da50f5-24b6-11e4-9659-d050991a7906  ONLINE  0  0  0   
  gptid/d3a6aa8f-24b6-11e4-9659-d050991a7906  ONLINE  0  0  0   
  gptid/d451290a-24b6-11e4-9659-d050991a7906  ONLINE  0  0  0   
  13344486131372377655  UNAVAIL  0  0  0  was /dev/gptid/a9196e3b-daab-11e5-8881-d050991a7
906.eli   
  gptid/d6052625-24b6-11e4-9659-d050991a7906  ONLINE  0  0  0   
   
errors: No known data errors   
   
  pool: freenas-boot   
 state: ONLINE   
  scan: none requested   
config:   
   
  NAME  STATE  READ WRITE CKSUM   
  freenas-boot  ONLINE  0  0  0   
  da0p2  ONLINE  0  0  0


Code:
[root@freenas ~]# camcontrol devlist   
<WDC WD30EFRX-68EUZN0 80.00A80>  at scbus0 target 0 lun 0 (ada0,pass0)   
<ST3000DM001-1CH166 CC29>  at scbus1 target 0 lun 0 (ada1,pass1)   
<WDC WD30EFRX-68EUZN0 82.00A82>  at scbus2 target 0 lun 0 (ada2,pass2)   
<WDC WD30EFRX-68EUZN0 80.00A80>  at scbus3 target 0 lun 0 (ada3,pass3)   
<Marvell Console 1.01>  at scbus9 target 0 lun 0 (pass4)   
<WDC WD30EFRX-68EUZN0 82.00A82>  at scbus14 target 0 lun 0 (ada4,pass5)   
<WDC WD30EFRX-68EUZN0 80.00A80>  at scbus15 target 0 lun 0 (ada5,pass6)   
<Kingston DataTraveler 2.0 1.00>  at scbus17 target 0 lun 0 (pass7,da0)
 
R

Robert Trevellyan

Pony Wrangler
Joined
May 16, 2014
Messages
3,778
Are you sure the array was healthy before you started?
michaelkoehler said:
the wizard failed
Click to expand...
Exactly what did you do in the wizard, and what error messages did you see? Hint: you don't run the wizard when you have an existing pool ready to import.

Right now, you have a RAIDZ2 vdev with two 'missing' disks, so your data is still there but with no redundancy, which is a precarious situation. Your goal is to replace the 'missing' disks, presumably with themselves, assuming the physical disks are healthy. Look in the documentation for how to replace a failed disk, but leave out the physical replacement steps. Triple check to make sure you know which disk is which - physically label them.

If you have any doubts about the physical health of the disks, run long SMART tests on them and post (between CODE tags) the output of smartctl -x for each disk.
 
M

michaelkoehler

Dabbler
Joined
Jul 8, 2014
Messages
17
Thanks for the reply, Robert.

I was following the latest guide http://doc.freenas.org/9.10/quick.html# (section 3).

First screen is default language, keyboard map, and timezone.
Next is AD setup, which I skipped.
Next is the volume creation. It allows you to create a pool, or, if there's an existing pool it populates the volume drop down. I selected this.
Next, it allows you to set shares and permissions. (I skipped this)
Finally, it lets you choose console messages and email alerts.

This is what I get;
Code:
Request Method: 	

POST 	
	
	 Request URL: 	 http://192.168.1.50/system/wizard/ 	
	
	 Software Version: 	 FreeNAS-9.10.1-U4 (ec9a7d3) 	
	
	 Exception Type: 	 AttributeError 	
	
	 Exception Value: 	
'NoneType' object has no attribute 'split'
	 	
	 Exception Location: 	 /usr/local/www/freenasUI/../freenasUI/system/forms.py in done, line 421 	
	
	 Server time: 	 Thu, 24 Nov 2016 11:25:57 -0800 	
	
Traceback

	 	 	 	 	Environment: Software Version: FreeNAS-9.10.1-U4 (ec9a7d3) Request Method: POST Request URL: http://192.168.1.50/system/wizard/ Traceback: File "/usr/local/lib/python2.7/site-packages/django/core/handlers/base.py" in get_response 105.					 response = middleware_method(request, callback, callback_args, callback_kwargs) File "/usr/local/www/freenasUI/../freenasUI/freeadmin/middleware.py" in process_view 156.		 return login_required(view_func)(request, *view_args, **view_kwargs) File "/usr/local/lib/python2.7/site-packages/django/contrib/auth/decorators.py" in _wrapped_view 22.				 return view_func(request, *args, **kwargs) File "/usr/local/lib/python2.7/site-packages/django/views/generic/base.py" in view 69.			 return self.dispatch(request, *args, **kwargs) File "/usr/local/lib/python2.7/site-packages/django/contrib/formtools/wizard/views.py" in dispatch 236.		 response = super(WizardView, self).dispatch(request, *args, **kwargs) File "/usr/local/lib/python2.7/site-packages/django/views/generic/base.py" in dispatch 87.		 return handler(request, *args, **kwargs) File "/usr/local/lib/python2.7/site-packages/django/contrib/formtools/wizard/views.py" in post 297.				 return self.render_done(form, **kwargs) File "/usr/local/lib/python2.7/site-packages/django/contrib/formtools/wizard/views.py" in render_done 350.		 done_response = self.done(final_form_list, **kwargs) File "/usr/local/www/freenasUI/../freenasUI/system/forms.py" in done 421.						 'volume_disks' Exception Type: AttributeError at /system/wizard/ Exception Value: 'NoneType' object has no attribute 'split' 

Request information
GET
	

No GET data

POST
	 	 		
		 Variable 		 Value 		
	 	 		 		
			__form_id 			u'dijit_form_Form_5' 		
		 		
			initial_wizard-current_step 			u'confirm' 		
		 	 	
FILES
	
No FILES data

COOKIES
	 	 		
		 Variable 		 Value 		
	 	 		 		
			sessionid 			'hd3dowbpj8teqdd316lfloxcq2hklcvn' 		
		 		
			csrftoken 			'J7vLi6hotLJvsZQueemKDpbYtSWMR0sF' 		
		 		
			fntreeSaveStateCookie 			'root' 		
		 	 	
META
	 	
		Variable 		Value 	
	 	 	 		
		 wsgi.errors 		 <flup.server.fcgi_base.TeeOutputStream object at 0x815ca7ad0> 		
	 		
		 SERVER_SOFTWARE 		 'nginx/1.8.1' 		
	 		
		 wsgi.run_once 		 False 		
	 		
		 wsgi.multiprocess 		 False 		
	 		
		 HTTP_ACCEPT_ENCODING 		 'gzip, deflate' 		
	 		
		 HTTP_HOST 		 '192.168.1.50'

Code:
Environment:

Software Version: FreeNAS-9.10.1-U4 (ec9a7d3)
Request Method: POST
Request URL: http://192.168.1.50/system/wizard/


Traceback:
File "/usr/local/lib/python2.7/site-packages/django/core/handlers/base.py" in get_response
  105.  response = middleware_method(request, callback, callback_args, callback_kwargs)
File "/usr/local/www/freenasUI/../freenasUI/freeadmin/middleware.py" in process_view
  156.  return login_required(view_func)(request, *view_args, **view_kwargs)
File "/usr/local/lib/python2.7/site-packages/django/contrib/auth/decorators.py" in _wrapped_view
  22.  return view_func(request, *args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/django/views/generic/base.py" in view
  69.  return self.dispatch(request, *args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/django/contrib/formtools/wizard/views.py" in dispatch
  236.  response = super(WizardView, self).dispatch(request, *args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/django/views/generic/base.py" in dispatch
  87.  return handler(request, *args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/django/contrib/formtools/wizard/views.py" in post
  297.  return self.render_done(form, **kwargs)
File "/usr/local/lib/python2.7/site-packages/django/contrib/formtools/wizard/views.py" in render_done
  350.  done_response = self.done(final_form_list, **kwargs)
File "/usr/local/www/freenasUI/../freenasUI/system/forms.py" in done
  421.  'volume_disks'

Exception Type: AttributeError at /system/wizard/
Exception Value: 'NoneType' object has no attribute 'split'




Request information
GET
	

No GET data

POST
	 	  		
 		 Variable 		 Value 		
	 	 		 		
			__form_id 			u'dijit_form_Form_5' 		
		 		
			initial_wizard-current_step 			u'confirm' 		
		 	 	
FILES
	
No FILES data

COOKIES
	 	  		
 		 Variable 		 Value 		
	 	 		 		
			sessionid 			'hd3dowbpj8teqdd316lfloxcq2hklcvn' 		
		 		
			csrftoken 			'J7vLi6hotLJvsZQueemKDpbYtSWMR0sF' 		
		 		
			fntreeSaveStateCookie 			'root' 		
		 	 	
META
	 	 
 		Variable 		Value 	
	 	 	 		
		 wsgi.errors 		 <flup.server.fcgi_base.TeeOutputStream object at 0x815ca7ad0> 		
	 		
		 SERVER_SOFTWARE 		 'nginx/1.8.1' 		
	 		
		 wsgi.run_once 		 False 		
	 		
		 wsgi.multiprocess 		 False 		
	 		
		 HTTP_ACCEPT_ENCODING 		 'gzip, deflate' 		
	 		
		 HTTP_HOST 		 '192.168.1.50' 		
	 		
		 wsgi.multithread 		 True 		
	 		
		 DOCUMENT_URI 		 '/system/wizard/' 		
	 		
		 REQUEST_URI 		 '/system/wizard/' 		
	 		
		 wsgi.input 		 <flup.server.fcgi_base.InputStream object at 0x81544ef10> 		
	 		
		 HTTP_USER_AGENT 		 'Mozilla/5.0 (Windows NT 10.0; WOW64; rv:50.0) Gecko/20100101 Firefox/50.0' 		
	 		
		 HTTP_COOKIE 		 'csrftoken=J7vLi6hotLJvsZQueemKDpbYtSWMR0sF; sessionid=hd3dowbpj8teqdd316lfloxcq2hklcvn; fntreeSaveStateCookie=root' 		
	 		
		 CONTENT_LENGTH 		 '63' 		
	 		
		 DOCUMENT_ROOT 		 '/usr/local/etc/nginx/html' 		
	 		
		 SERVER_ADDR 		 '192.168.1.50' 		
	 		
		 CSRF_COOKIE 		 u'J7vLi6hotLJvsZQueemKDpbYtSWMR0sF' 		
	 		
		 wsgi.url_scheme 		 'http' 		
	 		
		 wsgi.version 		 (1, 0) 		
	 		
		 SERVER_PROTOCOL 		 'HTTP/1.1' 		
	 		
		 QUERY_STRING 		 '' 		
	 		
		 HTTP_CONTENT_TYPE 		 'application/x-www-form-urlencoded' 		
	 		
		 SERVER_NAME 		 'localhost' 		
	 		
		 REQUEST_METHOD 		 'POST' 		
	 		
		 HTTP_X_CSRFTOKEN 		 'J7vLi6hotLJvsZQueemKDpbYtSWMR0sF' 		
	 		
		 HTTP_ACCEPT 		 'text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8' 		
	 		
		 REMOTE_PORT 		 '52450' 		
	 		
		 PATH_INFO 		 u'/system/wizard/' 		
	 		
		 REMOTE_ADDR 		 '192.168.1.10' 		
	 		
		 REDIRECT_STATUS 		 '200' 		
	 		
		 GATEWAY_INTERFACE 		 'CGI/1.1' 		
	 		
		 HTTP_CONNECTION 		 'keep-alive' 		
	 		
		 HTTP_REFERER 		 'http://192.168.1.50/' 		
	 		
		 HTTP_X_REQUESTED_WITH 		 'XMLHttpRequest' 		
	 		
		 SCRIPT_NAME 		 u'' 		
	 		
		 HTTP_DNT 		 '1' 		
	 		
		 SERVER_PORT 		 '80' 		
	 		
		 HTTP_CONTENT_LENGTH 		 '63' 		
	 		
		 HTTPS 		 '' 		
	 		
		 CONTENT_TYPE 		 'application/x-www-form-urlencoded' 		
	 		
		 HTTP_ACCEPT_LANGUAGE 		 'en-US,en;q=0.5'


It doesn't appear to do anything. If I then import volume, I get the degraded volume.

The weird part is, switching back to the old USB boot device it's fine.

Thanks again,
Mike
 
R

Robert Trevellyan

Pony Wrangler
Joined
May 16, 2014
Messages
3,778
michaelkoehler said:
This is what I get
Click to expand...
Looks like a bug report may be called for.
michaelkoehler said:
switching back to the old USB boot device it's fine
Click to expand...
"Fine" as in the volume is not degraded, or just no error report?

EDIT: if the volume is not degraded with the older version, then my guess is that there's a driver issue with the new version that results in the two drives you have connected to a Marvel chipset controller not being recognized.
 
M

michaelkoehler

Dabbler
Joined
Jul 8, 2014
Messages
17
I think you may be right, Robert.
Funny thing, as I got out of bed this morning, I thought "What if the problem is that those two drives are on a controller that doesn't have a driver in this version of FreeNAS?" That would explain why they're there in the version I've been updating for over two years, but not in the new version. I'll have to investigate that a little more.
 
joeschmuck

joeschmuck

Old Man
Moderator
Joined
May 28, 2011
Messages
10,994
Please make sure that you submit a well documented bug report if the the older version works without issue but the newer version does have issues.

Also, what was the old version of FreeNAS? and the new version of FreeNAS? I don't like to guess.
 
M

michaelkoehler

Dabbler
Joined
Jul 8, 2014
Messages
17
Old is FreeNAS-9.10.1-U2 (f045a8b).
New is FreeNAS-9.10.1-U4 (ec9a7d3)

My theory, however, is that the Marvel SATA ports were supported in the original install (9.3 I think) and survived upgrades through 9.10.1, where they're no longer supported.

I've found a version of 9.3 I downloaded in early 2015. I want to try installing that and see what happens.
 
joeschmuck

joeschmuck

Old Man
Moderator
Joined
May 28, 2011
Messages
10,994
If FreeNAS-9.10.1-U2 (f045a8b) worked fine then I'd just use that and then generate a bug report.
 
M

michaelkoehler

Dabbler
Joined
Jul 8, 2014
Messages
17
Well, I got the same thing with 9.3 - volume degraded.

Then, I moved those two drives off the Marvell controller to the Intel controller with the same results.

I'm on FreeNAS-9.10.1-U2 (f045a8b) and running SMART long now. I guess I'll do a bug report after that finishes, but I'm not sure I have much useful information.
 
R

Robert Trevellyan

Pony Wrangler
Joined
May 16, 2014
Messages
3,778
Sounds like there may be a problem with the drives after all, not a bug in FreeNAS.
 
Status
Not open for further replies.

Similar threads

M
zpool disks showing offline
Replies
1
Views
1K
mroptman
mroptman
D
  • Locked
Can't import pool. Drives "unavailable"
2
Replies
35
Views
6K
dmo
D
O
Failed Disk - Trying to Replace - No other Member Disk (UI)
Replies
1
Views
921
onlineforums
O
Junicast
  • Locked
Degraded volume after update 11.0-U4
Replies
18
Views
3K
SweetAndLow
SweetAndLow
T
  • Locked
ZPOOL degraded, hdd failed and so did my attempt to replace
Replies
3
Views
2K
paleoN
paleoN
Top