Running filter on ZFS Snapshots returns: "Sorry, an error occurred"

Status
Not open for further replies.

Apollo

Wizard
Joined
Jun 13, 2013
Messages
1,458
Running FREENAS 9.2.1.8 after upgrading from 9.2.1.7, I am still experiencing some Web GUI error messages or sometime the content of the pane never seem to display its content.

Specs:
FreeNAS-9.2.1.8-RELEASE-x64 (e625626)
Supermicro X10SL7-F (SAS in IT mode)
Intel Xeon E3-1241 v3
Crucial 32GB Unbuffered ECC 1.5v 2 x CT2KIT102472BA160B
6 x WD RED 4TB in RAIDZ2

When displaying my snapshots in WEB GUI and run a filter to isolate specific snapshots, I will get after a few seconds the "Sorry, an error occurred" in the WEB GUI.
At the same time, the message footer will output the following error message:
Code:
pid 36730 (nginx), uid 80 inumber 27884 on /var: filesystem full


I tried to run "save debug" from the "System->Setting->Advanced", and I will get the following message to appear in my browser:

Code:
<html><head>
<meta http-equiv="content-type" content="text/html; charset=windows-1252"><style type="text/css"> #fi #fic {margin-right:100px !important}  #fi #rh {margin-left:-115px !important;width:95px !important}  #fi .rh {display:none !important}  body:not(.xE) div[role='main'] .Bu:not(:first-child) {display: none !important} </style></head><body><div id="summary">
  <table class="meta">
    <tbody><tr>
      <th>Request Method:</th>
      <td>GET</td>
    </tr>
    <tr>
      <th>Request URL:</th>
      <td>https://192.168.0.194/system/debug/</td>
    </tr>
    <tr>
      <th>Software Version:</th>
      <td>FreeNAS-9.2.1.8-RELEASE-x64 (e625626)</td>
    </tr>
    <tr>
      <th>Exception Type:</th>
      <td>IOError</td>
    </tr>
    <tr>
      <th>Exception Value:</th>
      <td><pre>[Errno 2] No such file or directory: u'/mnt/WD-RAIDZ2/.system/ixdiagnose/ixdiagnose.tgz'</pre></td>
    </tr>
    <tr>
      <th>Exception Location:</th>
      <td>/usr/local/www/freenasUI/../freenasUI/system/views.py in debug, line 692</td>
    </tr>
    <tr>
      <th>Server time:</th>
      <td>Sun, 26 Oct 2014 11:31:30 -0700</td>
    </tr>
  </tbody></table>
</div>



<div id="traceback">
  <h2>Traceback</h2>
 
  <div id="browserTraceback">

  </div>
 
  <form action="http://dpaste.com/" name="pasteform" id="pasteform" method="post" target="_blank">
  <div id="pastebinTraceback" class="pastebin">
    <input name="language" value="PythonConsole" type="hidden">
    <input name="title" value="IOError at /system/debug/" type="hidden">
    <input name="source" value="Django Dpaste Agent" type="hidden">
    <input name="poster" value="Django" type="hidden">
    <textarea name="content" cols="120" rows="25" readonly="yes" data-dojo-type="dijit.form.Textarea">Environment:

Software Version: FreeNAS-9.2.1.8-RELEASE-x64 (e625626)
Request Method: GET
Request URL: https://192.168.0.194/system/debug/


Traceback:
File "/usr/local/lib/python2.7/site-packages/django/core/handlers/base.py" in get_response
  107.                     response = middleware_method(request, callback, callback_args, callback_kwargs)
File "/usr/local/www/freenasUI/../freenasUI/freeadmin/middleware.py" in process_view
  158.         return login_required(view_func)(request, *view_args, **view_kwargs)
File "/usr/local/lib/python2.7/site-packages/django/contrib/auth/decorators.py" in _wrapped_view
  22.                 return view_func(request, *args, **kwargs)
File "/usr/local/www/freenasUI/../freenasUI/system/views.py" in debug
  692.         wrapper = FileWrapper(file(dump))

Exception Type: IOError at /system/debug/
Exception Value: [Errno 2] No such file or directory: u'/mnt/WD-RAIDZ2/.system/ixdiagnose/ixdiagnose.tgz'
</textarea>
  <br><br>
  <!-- <input type="submit" value="Share this traceback on a public Web site"> -->
  </div>
</form>
</div>

<div id="requestinfo">
  <h2>Request information</h2>

  <h3 id="get-info">GET</h3>
 
    <p>No GET data</p>
 

  <h3 id="post-info">POST</h3>
 
    <p>No POST data</p>
 
  <h3 id="files-info">FILES</h3>
 
    <p>No FILES data</p>
 


  <h3 id="cookie-info">COOKIES</h3>
 
    <table class="req">
      <thead>
        <tr>
          <th>Variable</th>
          <th>Value</th>
        </tr>
      </thead>
      <tbody>
       
          <tr>
            <td>csrftoken</td>
            <td class="code">'eByOmjz7srVIfqnCif9JOSA5KY32l4M7'</td>
          </tr>
       
          <tr>
            <td>sessionid</td>
            <td class="code">'zly3trkyrsigjzk0jb3wmpa6eup40f43'</td>
          </tr>
       
          <tr>
            <td>fntreeSaveStateCookie</td>
            <td class="code">'root%2Croot%2F223%2Croot%2F47%2F60%2Croot%2F47%2F57%2Croot%2F47%2F53%2Croot%2F10%2F32%2Croot%2F52%2Croot%2F252%2Croot%2F254%2Croot%2F254%2F260%2Croot%2F249%2Croot%2F249%2F255%2Croot%2F249%2F255%2F257%2Croot%2F245%2Croot%2F248%2Croot%2F250%2Croot%2F250%2F256%2Croot%2F250%2F256%2F258%2Croot%2F251%2Croot%2F310%2Croot%2F312%2Croot%2F274%2Croot%2F276%2Croot%2F271%2F277%2Croot%2F271%2F277%2F279%2Croot%2F318%2Croot%2F320%2Croot%2F307%2Croot%2F307%2F313%2Croot%2F307%2F313%2F315%2Croot%2F316%2Croot%2F316%2F322%2Croot%2F316%2F322%2F324%2Croot%2F267%2Croot%2F267%2F274%2Croot%2F314%2Croot%2F314%2F320%2Croot%2F314%2F320%2F322%2Croot%2F421%2Croot%2F464%2Croot%2F466%2Croot%2F466%2F472%2F474%2Croot%2F1%2Croot%2F1%2F6%2Croot%2F305%2Croot%2F637%2Croot%2F635%2Croot%2F619%2Croot%2F10%2F30%2Croot%2F10%2F26%2Croot%2F615%2Croot%2F617%2Croot%2F617%2F623%2Croot%2F475%2Croot%2F467%2Croot%2F467%2F473%2Croot%2F467%2F473%2F475%2Croot%2F309%2Croot%2F10%2F11%2Croot%2F62%2Croot%2F62%2F63%2Croot%2F62%2F248%2Croot%2F62%2F85%2Croot%2F268%2Croot%2F284%2Croot%2F268%2F275%2Croot%2F326%2Croot%2F329%2F335%2F337%2Croot%2F330%2Croot%2F287%2Croot%2F333%2F339%2F341%2Croot%2F336%2Croot%2F336%2F342%2Croot%2F336%2F342%2F344%2Croot%2F276%2F283%2Croot%2F337%2Croot%2F337%2F343%2F345%2Croot%2F332%2Croot%2F334%2Croot%2F337%2F364%2F366%2Croot%2F276%2F280%2Croot%2F280%2Croot%2F280%2F284%2Croot%2F296%2Croot%2F343%2Croot%2F343%2F370%2Croot%2F343%2F370%2F372%2Croot%2F343%2F349%2Croot%2F343%2F349%2F351%2Croot%2F284%2F293%2Croot%2F121%2Croot%2F8%2Croot%2F8%2F32%2Croot%2F1%2F2%2Croot%2F1%2F5%2Croot%2F50%2Croot%2F50%2F51%2Croot%2F264%2Croot%2F52%2F262%2Croot%2F277%2Croot%2F321%2Croot%2F332%2F342%2Croot%2F332%2F346%2Croot%2F332%2F350%2F352%2Croot%2F332%2F338%2F340%2Croot%2F332%2F346%2F348%2Croot%2F10%2F34%2Croot%2F10%2F14%2Croot%2F288%2Croot%2F53%2Croot%2F53%2F267%2Croot%2F10%2F17%2Croot%2F332%2F338%2Croot%2F53%2F60%2Croot%2F351%2Croot%2F351%2F369%2Croot%2F351%2F369%2F371%2Croot%2F351%2F357%2Croot%2F351%2F357%2F359%2Croot%2F334%2F340%2Croot%2F334%2F340%2F342%2Croot%2F333%2Croot%2F333%2F339%2Croot%2F329%2Croot%2F38%2Croot%2F10'</td>
          </tr>
       
      </tbody>
    </table>
 

  <h3 id="meta-info">META</h3>
  <table class="req">
    <thead>
      <tr>
        <th>Variable</th>
        <th>Value</th>
      </tr>
    </thead>
    <tbody>
     
        <tr>
          <td>wsgi.multiprocess</td>
          <td class="code">False</td>
        </tr>
     
        <tr>
          <td>HTTP_REFERER</td>
          <td class="code">'https://192.168.0.194/'</td>
        </tr>
     
        <tr>
          <td>REDIRECT_STATUS</td>
          <td class="code">'200'</td>
        </tr>
     
        <tr>
          <td>SERVER_SOFTWARE</td>
          <td class="code">'nginx/1.4.4'</td>
        </tr>
     
        <tr>
          <td>SCRIPT_NAME</td>
          <td class="code">u''</td>
        </tr>
     
        <tr>
          <td>REQUEST_METHOD</td>
          <td class="code">'GET'</td>
        </tr>
     
        <tr>
          <td>PATH_INFO</td>
          <td class="code">u'/system/debug/'</td>
        </tr>
     
        <tr>
          <td>SERVER_PROTOCOL</td>
          <td class="code">'HTTP/1.1'</td>
        </tr>
     
        <tr>
          <td>QUERY_STRING</td>
          <td class="code">''</td>
        </tr>
     
        <tr>
          <td>CONTENT_LENGTH</td>
          <td class="code">''</td>
        </tr>
     
        <tr>
          <td>HTTP_USER_AGENT</td>
          <td class="code">'Mozilla/5.0 (Windows NT 6.1; WOW64; rv:33.0) Gecko/20100101 Firefox/33.0'</td>
        </tr>
     
        <tr>
          <td>HTTP_CONNECTION</td>
          <td class="code">'keep-alive'</td>
        </tr>
     
        <tr>
          <td>HTTP_COOKIE</td>
          <td class="code">'csrftoken=eByOmjz7srVIfqnCif9JOSA5KY32l4M7;
sessionid=zly3trkyrsigjzk0jb3wmpa6eup40f43;
fntreeSaveStateCookie=root%2Croot%2F223%2Croot%2F47%2F60%2Croot%2F47%2F57%2Croot%2F47%2F53%2Croot%2F10%2F32%2Croot%2F52%2Croot%2F252%2Croot%2F254%2Croot%2F254%2F260%2Croot%2F249%2Croot%2F249%2F255%2Croot%2F249%2F255%2F257%2Croot%2F245%2Croot%2F248%2Croot%2F250%2Croot%2F250%2F256%2Croot%2F250%2F256%2F258%2Croot%2F251%2Croot%2F310%2Croot%2F312%2Croot%2F274%2Croot%2F276%2Croot%2F271%2F277%2Croot%2F271%2F277%2F279%2Croot%2F318%2Croot%2F320%2Croot%2F307%2Croot%2F307%2F313%2Croot%2F307%2F313%2F315%2Croot%2F316%2Croot%2F316%2F322%2Croot%2F316%2F322%2F324%2Croot%2F267%2Croot%2F267%2F274%2Croot%2F314%2Croot%2F314%2F320%2Croot%2F314%2F320%2F322%2Croot%2F421%2Croot%2F464%2Croot%2F466%2Croot%2F466%2F472%2F474%2Croot%2F1%2Croot%2F1%2F6%2Croot%2F305%2Croot%2F637%2Croot%2F635%2Croot%2F619%2Croot%2F10%2F30%2Croot%2F10%2F26%2Croot%2F615%2Croot%2F617%2Croot%2F617%2F623%2Croot%2F475%2Croot%2F467%2Croot%2F467%2F473%2Croot%2F467%2F473%2F475%2Croot%2F309%2Croot%2F10%2F11%2Croot%2F62%2Croot%2F62%2F63%2Croot%2F62%2F248%2Croot%2F62%2F85%2Croot%2F268%2Croot%2F284%2Croot%2F268%2F275%2Croot%2F326%2Croot%2F329%2F335%2F337%2Croot%2F330%2Croot%2F287%2Croot%2F333%2F339%2F341%2Croot%2F336%2Croot%2F336%2F342%2Croot%2F336%2F342%2F344%2Croot%2F276%2F283%2Croot%2F337%2Croot%2F337%2F343%2F345%2Croot%2F332%2Croot%2F334%2Croot%2F337%2F364%2F366%2Croot%2F276%2F280%2Croot%2F280%2Croot%2F280%2F284%2Croot%2F296%2Croot%2F343%2Croot%2F343%2F370%2Croot%2F343%2F370%2F372%2Croot%2F343%2F349%2Croot%2F343%2F349%2F351%2Croot%2F284%2F293%2Croot%2F121%2Croot%2F8%2Croot%2F8%2F32%2Croot%2F1%2F2%2Croot%2F1%2F5%2Croot%2F50%2Croot%2F50%2F51%2Croot%2F264%2Croot%2F52%2F262%2Croot%2F277%2Croot%2F321%2Croot%2F332%2F342%2Croot%2F332%2F346%2Croot%2F332%2F350%2F352%2Croot%2F332%2F338%2F340%2Croot%2F332%2F346%2F348%2Croot%2F10%2F34%2Croot%2F10%2F14%2Croot%2F288%2Croot%2F53%2Croot%2F53%2F267%2Croot%2F10%2F17%2Croot%2F332%2F338%2Croot%2F53%2F60%2Croot%2F351%2Croot%2F351%2F369%2Croot%2F351%2F369%2F371%2Croot%2F351%2F357%2Croot%2F351%2F357%2F359%2Croot%2F334%2F340%2Croot%2F334%2F340%2F342%2Croot%2F333%2Croot%2F333%2F339%2Croot%2F329%2Croot%2F38%2Croot%2F10'</td>
        </tr>
     
        <tr>
          <td>SERVER_NAME</td>
          <td class="code">'localhost'</td>
        </tr>
     
        <tr>
          <td>REMOTE_PORT</td>
          <td class="code">'50350'</td>
        </tr>
     
        <tr>
          <td>wsgi.url_scheme</td>
          <td class="code">'https'</td>
        </tr>
     
        <tr>
          <td>SERVER_PORT</td>
          <td class="code">'443'</td>
        </tr>
     
        <tr>
          <td>SERVER_ADDR</td>
          <td class="code">'192.168.0.194'</td>
        </tr>
     
        <tr>
          <td>DOCUMENT_ROOT</td>
          <td class="code">'/usr/local/etc/nginx/html'</td>
        </tr>
     
        <tr>
          <td>DOCUMENT_URI</td>
          <td class="code">'/system/debug/'</td>
        </tr>
     
        <tr>
          <td>wsgi.input</td>
          <td class="code">&lt;flup.server.fcgi_base.InputStream object at 0x80ac89b90&gt;</td>
        </tr>
     
        <tr>
          <td>HTTP_DNT</td>
          <td class="code">'1'</td>
        </tr>
     
        <tr>
          <td>HTTP_HOST</td>
          <td class="code">'192.168.0.194'</td>
        </tr>
     
        <tr>
          <td>HTTPS</td>
          <td class="code">'on'</td>
        </tr>
     
        <tr>
          <td>wsgi.multithread</td>
          <td class="code">True</td>
        </tr>
     
        <tr>
          <td>REQUEST_URI</td>
          <td class="code">'/system/debug/'</td>
        </tr>
     
        <tr>
          <td>HTTP_ACCEPT</td>
          <td class="code">'text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8'</td>
        </tr>
     
        <tr>
          <td>wsgi.version</td>
          <td class="code">(1, 0)</td>
        </tr>
     
        <tr>
          <td>GATEWAY_INTERFACE</td>
          <td class="code">'CGI/1.1'</td>
        </tr>
     
        <tr>
          <td>wsgi.run_once</td>
          <td class="code">False</td>
        </tr>
     
        <tr>
          <td>wsgi.errors</td>
          <td class="code">&lt;flup.server.fcgi_base.TeeOutputStream object at 0x8130de990&gt;</td>
        </tr>
     
        <tr>
          <td>REMOTE_ADDR</td>
          <td class="code">'192.168.0.192'</td>
        </tr>
     
        <tr>
          <td>HTTP_ACCEPT_LANGUAGE</td>
          <td class="code">'en-US,en;q=0.5'</td>
        </tr>
     
        <tr>
          <td>CONTENT_TYPE</td>
          <td class="code">''</td>
        </tr>
     
        <tr>
          <td>CSRF_COOKIE</td>
          <td class="code">u'eByOmjz7srVIfqnCif9JOSA5KY32l4M7'</td>
        </tr>
     
        <tr>
          <td>HTTP_ACCEPT_ENCODING</td>
          <td class="code">'gzip, deflate'</td>
        </tr>
     
    </tbody>
  </table>

</div>
</body></html>


I have run the following command found while Googling for the nginx error message and returned the following:

Code:
df -h /var
Filesystem  Size  Used  Avail Capacity  Mounted on
/dev/md2  149M  148M  -11M  108%  /var


Currently, I have in the following tab "System->Settings->System Dataset" which might have been unchecked in the past:

System dataset pool: WD-RAIDZ2
Syslog: Checked
Reporting Database: Checked.

Note: Just before the upgrade (during that time I already experienced "filesystem full" error messages) I backed-up my config then ran the upgrade procedure.
After reboot, FREENAS was successfully set to 9.2.1.8 but the config was not restored as FREENAS was complaining the file was corrupted. I had to reconfigure FREENAS config from scratch.

All in all, I believe the source cause of the problem is related to the Filesystem. Unforttunately, I do not not how to go by and fix it.
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
Just how full is your filesystem? Is it brushing up against any quotas you might have set?
 

Apollo

Wizard
Joined
Jun 13, 2013
Messages
1,458
Just how full is your filesystem? Is it brushing up against any quotas you might have set?

My ZFS pool has 7.1TB space available and no quota set.
RAM: 2.9G Free, 278M Active, 0 Cache, 1016.3M Inactive, 26.8G Wired.

Does it answer your question?
 
Status
Not open for further replies.
Top