Unable to detect target on SAN when using a Fiber Switch

[paulswansea]

I have set up a FreeNAS server with iSCSI and attached it to my pc by using QLogic 4gb Fiber HBAs (QLE2460 & QLE2462). I'm able to detect the target and boot from it successfully by connecting a fiber cable directly between them.

However, plugging them both into a brocade 5000 fiber channel switch, I am no longer able to detect the target. I have spoken on the brocade forum, and they have confirmed that all the settings on the switch are correct and everything is as it should be.

I noticed when I plug them into the switch, I get the following messages repeated on the FreeNAS screen which are not there when I connect the FreeNAS server to my PC directly.

isp1: CTIO returned by f/w- Port Logout
isp1: isp_handle_platform_ctio: CTIO7[1157e0] seq 0 nc 1 sts 0x29 flg 0xa060 sns 0 resid 0 FIN

Is this an issue with FreeBSD / FreeNAS? Can I change settings somewhere to fix this?

 

[dlavigne]

Were you able to figure this out?

 

[paulswansea]

Were you able to figure this out?

Hi,

No, I'm completely stuck, can you tell me, how would that error come about? Is there a chance that the switch is making that error come up? It only seems to do it when plugged into the switch.

 

[mav@]

What is your FreeNAS version? Make sure it is the latest one.

Does your switch have zoning enabled? Make sure is it properly configured.

If neither of those help, please attach full dmesg output after setting hint.isp.0.debug=0x110f and hint.isp.1.debug=0x110f loader tunables.

 

[paulswansea]

Hi mav@,

I'm currently running 9.3 Nightlies. The switch has zoning enabled, and it's all configured correctly.

Below are the dmesg results as requested :

isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x4 reason 0x6)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PLOGX Logout PortID 0x010100 nphdl 0x1
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 [0] PortID 0x010100 Departed because of Gone Device Timeout
ctlfeasync: WWPN 0x500143800635db76 port 0x010100 path 1 target 0 left
isp1: Chan 0 Stopping Gone Device Timer @ 870
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 vtgt 0 (INI) added
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (INI) arrived
ctlfeasync: WWPN 0x500143800635db76 port 0x010100 path 1 target 0 arrived
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x4 reason 0x6)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 changes PRLI Word 3 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis)
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) changed
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 Starting Gone Device Timer with 30 seconds time now 893
isp1: Chan 0 PLOGX Logout PortID 0x010100 nphdl 0x1
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: CTIO returned by f/w- Port Logout
isp1: isp_handle_platform_ctio: CTIO7[120b7c] seq 0 nc 1 sts 0x29 flg 0xa060 sns 0 resid 0 FIN
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x7 reason 0x17)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 vtgt 0 deleted
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PORT LOGOUT (sub-status 0x6) for N-port handle 0x1
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x4 reason 0x6)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PLOGX Logout PortID 0x010100 nphdl 0x1
isp1: CTIO returned by f/w- Port Logout
isp1: isp_handle_platform_ctio: CTIO7[120ba8] seq 0 nc 1 sts 0x29 flg 0xa060 sns 0 resid 0 FIN
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x7 reason 0x17)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 vtgt 0 deleted
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PORT LOGOUT (sub-status 0x6) for N-port handle 0x1
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x4 reason 0x6)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PLOGX Logout PortID 0x010100 nphdl 0x1
isp1: CTIO returned by f/w- Port Logout
isp1: isp_handle_platform_ctio: CTIO7[120bd4] seq 0 nc 1 sts 0x29 flg 0xa060 sns 0 resid 0 FIN
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x7 reason 0x17)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 vtgt 0 deleted
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PORT LOGOUT (sub-status 0x6) for N-port handle 0x1
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x4 reason 0x6)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PLOGX Logout PortID 0x010100 nphdl 0x1
isp1: CTIO returned by f/w- Port Logout
isp1: isp_handle_platform_ctio: CTIO7[120c00] seq 0 nc 1 sts 0x29 flg 0xa060 sns 0 resid 0 FIN
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x7 reason 0x17)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 vtgt 0 deleted
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PORT LOGOUT (sub-status 0x6) for N-port handle 0x1
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x4 reason 0x6)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PLOGX Logout PortID 0x010100 nphdl 0x1
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x4 reason 0x6)
isp1: Chan 0 Loop changed
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PLOGX Logout PortID 0x010100 nphdl 0x1
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: CTIO returned by f/w- Port Logout
isp1: isp_handle_platform_ctio: CTIO7[120c2c] seq 0 nc 1 sts 0x29 flg 0xa060 sns 0 resid 0 FIN
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x7 reason 0x17)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 vtgt 0 deleted
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PORT LOGOUT (sub-status 0x6) for N-port handle 0x1
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x4 reason 0x6)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PLOGX Logout PortID 0x010100 nphdl 0x1
isp1: CTIO returned by f/w- Port Logout
isp1: isp_handle_platform_ctio: CTIO7[120c58] seq 0 nc 1 sts 0x29 flg 0xa060 sns 0 resid 0 FIN
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x7 reason 0x17)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 vtgt 0 deleted
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PORT LOGOUT (sub-status 0x6) for N-port handle 0x1
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x4 reason 0x6)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PLOGX Logout PortID 0x010100 nphdl 0x1
isp1: CTIO returned by f/w- Port Logout
isp1: isp_handle_platform_ctio: CTIO7[120c84] seq 0 nc 1 sts 0x29 flg 0xa060 sns 0 resid 0 FIN
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x7 reason 0x17)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 vtgt 0 deleted
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PORT LOGOUT (sub-status 0x6) for N-port handle 0x1
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x4 reason 0x6)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PLOGX Logout PortID 0x010100 nphdl 0x1
isp1: CTIO returned by f/w- Port Logout
isp1: isp_handle_platform_ctio: CTIO7[120cb0] seq 0 nc 1 sts 0x29 flg 0xa060 sns 0 resid 0 FIN
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x7 reason 0x17)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 vtgt 0 deleted
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PORT LOGOUT (sub-status 0x6) for N-port handle 0x1
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x4 reason 0x6)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PLOGX Logout PortID 0x010100 nphdl 0x1
isp1: CTIO returned by f/w- Port Logout
isp1: isp_handle_platform_ctio: CTIO7[120cdc] seq 0 nc 1 sts 0x29 flg 0xa060 sns 0 resid 0 FIN
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x7 reason 0x17)
isp1: Chan 0 Loop changed
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 vtgt 0 deleted
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie
isp1: Chan 0 PORT LOGOUT (sub-status 0x6) for N-port handle 0x1
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [2] WWPN 0x2101001b32afc740 PortID 0x010200 handle 0x2 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 FC PDB sync done
isp1: Chan 0 FC got to Ready state
isp1: Chan 0 Loop is up
isp1: Chan 0 sleep for 0 seconds
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Port Database Changed (nphdl 0x1 state 0x4 reason 0x6)
isp1: Chan 0 Loop changed
isp1: Chan 0 WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 reentered
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) stayed
isp1: Chan 0 Checking FC state
isp1: Chan 0 FC loop scan
isp1: Chan 0 FC loop scan done (no loop)
isp1: Chan 0 FC fabric scan
isp1: Chan 0 Got 2 ports back from name server
isp1: Chan 0 Checking fabric port 0x010000
isp1: Chan 0 Port 0x010000 is our
isp1: Chan 0 Checking fabric port 0x010200
isp1: Chan 0 Port 0x010200@0x0002 is valid
isp1: Chan 0 FC fabric scan done
isp1: Chan 0 FC PDB sync
isp1: Chan 0 [0] WWPN 0x500143800635db76 PortID 0x010100 handle 0x1 (REC,RetryID,Retry,CNFRM,INI,RdXfrDis) gone zombie

The full results are in attached file.

 

[IAPro]

Sorry for digging up an old thread,but was there any resolution to this? I am seeing what I believe to be the same thing with FreeBSD 10.3-RELEASE-p7.

Perhaps I can provide more details also. I'm using QLogic QLE2462 cards in the workstations and a QLE2464 card in the server. I have this running through a Brocade Silkworm 4100, running the latest available version of firmware available for the 4100 (6.4.3h). All QLogic cards have been flashed to the latest version of the firmware (8.01.02) and BIOS (2.32.05).

I'm using NPIV (hint.isp.n.vports=8) and created zvols that are being provided as LUNs (one LUN per virtual port). The Silkworm firmware fully supports NPIV. I want only the LUN for each workstation visible from that workstation. Traditionally, I would have used the SAN's "LUN masking" or "mapping" but that is not available in FreeBSD/FreeNAS CTL per https://forums.freebsd.org/threads/34510/ and https://lists.freebsd.org/pipermail/freebsd-scsi/2013-December/006146.html. I am not sure if the NPIV discussion is relevant, I'm including it here for full context.

All workstations/servers see the correct LUN(s) zoned to them via the switch when they're running an OS from a local disk, exactly as expected. This is true from Linux, VMware ESXi and Windows. So I am sure that my vport (NPIV) and switch zoning configuration is correct.

However, in the QLogic BIOS before OS boot, they do NOT show and cannot be configured to boot from. When I plug directly into a FC port on the FreeBSD server, I CAN see LUNs in the QLogic BIOS. Of course, all of the LUNs show for all of the different initiators as there is no switch inline to do zoning.

Here is the critical part that has me thinking that FreeBSD/FreeNAS CTL is at least partially to blame. Plugged through the switch, if I add our FC connected LTO tape drive to a workstation's zone, it shows up in the QLogic BIOS of that workstation, but the FreeBSD hosted LUNs do not.

Here is the output of ctladm port -l. The four LUNS on isp0-isp3 are the targets I'm trying to present to the FC initiators/workstations, showing them to be correctly configured. Again, these are visible from a booted operating system but not from the QLogic BIOS through the switch, but are visible in the BIOS with the initiators plugged directly to the server:

Code:

Port Online Frontend Name	 pp vp
0	YES	ioctl	ioctl	0  0 
1	YES	tpc	  tpc	  0  0 
2	NO	 camsim   camsim   0  0  naa.5000000bae755b03
3	NO	 camtgt   isp0	 0  0 
4	YES	camtgt   isp0	 1  0  naa.2202001b324abde0
5	YES	camtgt   isp0	 2  0  naa.2302001b324abde0
6	YES	camtgt   isp0	 3  0  naa.2402001b324abde0
7	YES	camtgt   isp0	 4  0  naa.2502001b324abde0
8	NO	 camtgt   isp0	 5  0 
9	NO	 camtgt   isp0	 6  0 
10   NO	 camtgt   isp0	 7  0 
11   NO	 camtgt   isp0	 8  0 
12   NO	 camtgt   isp1	 0  0 
13   YES	camtgt   isp1	 1  0  naa.2203001b326abde0
14   YES	camtgt   isp1	 2  0  naa.2303001b326abde0
15   YES	camtgt   isp1	 3  0  naa.2403001b326abde0
16   YES	camtgt   isp1	 4  0  naa.2503001b326abde0
17   NO	 camtgt   isp1	 5  0 
18   NO	 camtgt   isp1	 6  0 
19   NO	 camtgt   isp1	 7  0 
20   NO	 camtgt   isp1	 8  0 
21   NO	 camtgt   isp2	 0  0 
22   YES	camtgt   isp2	 1  0  naa.2200001b320abde0
23   YES	camtgt   isp2	 2  0  naa.2300001b320abde0
24   YES	camtgt   isp2	 3  0  naa.2400001b320abde0
25   YES	camtgt   isp2	 4  0  naa.2500001b320abde0
26   NO	 camtgt   isp2	 5  0 
27   NO	 camtgt   isp2	 6  0 
28   NO	 camtgt   isp2	 7  0 
29   NO	 camtgt   isp2	 8  0 
30   NO	 camtgt   isp3	 0  0 
31   YES	camtgt   isp3	 1  0  naa.2201001b322abde0
32   YES	camtgt   isp3	 2  0  naa.2301001b322abde0
33   YES	camtgt   isp3	 3  0  naa.2401001b322abde0
34   YES	camtgt   isp3	 4  0  naa.2501001b322abde0
35   NO	 camtgt   isp3	 5  0 
36   NO	 camtgt   isp3	 6  0 
37   NO	 camtgt   isp3	 7  0 
38   NO	 camtgt   isp3	 8  0 

 

[mav@]

Here is the critical part that has me thinking that FreeBSD/FreeNAS CTL is at least partially to blame. Plugged through the switch, if I add our FC connected LTO tape drive to a workstation's zone, it shows up in the QLogic BIOS of that workstation, but the FreeBSD hosted LUNs do not.

Could you compare what your switch name server thinks about the LTO drive and your server? I think I've implemented all possible ports NS registration in isp(4) driver, but who knows? When you connect directly port to port, there is no name server, and discovery happens in different way.

 

[IAPro]

Going to try to do this in the next few days, I haven't forgotten... Thanks!

 

[IAPro]

Here is some output from the Brocade switch. Ports 0 - 3 are attached to the FreeBSD server, and 14 and 15 are attached to the workstation.

First, basic information about the switch and what's attached to the ports:

Code:

Fabric_A:root> firmwareshow
Appl	 Primary/Secondary Versions
------------------------------------------
FOS	  v6.4.3h
		 v6.4.3h
Fabric_A:root> switchshow
switchName:	 Fabric_A
switchType:	 32.0
switchState:	Online
switchMode:	 Native
switchRole:	 Principal
switchDomain:   1
switchId:	   fffc01
switchWwn:	  10:00:00:05:1e:03:78:99
zoning:		 ON (cfg)
switchBeacon:   OFF

Index Port Address Media Speed State	 Proto
==============================================
  0   0   010000   id	N4   Online	  FC  F-Port  1 N Port + 4 NPIV public
  1   1   010100   id	N4   Online	  FC  F-Port  1 N Port + 4 NPIV public
  2   2   010200   id	N4   Online	  FC  F-Port  1 N Port + 4 NPIV public
  3   3   010300   id	N4   Online	  FC  F-Port  1 N Port + 4 NPIV public
  4   4   010400   id	N4   Online	  FC  F-Port  50:01:10:a0:01:28:9a:9c
  5   5   010500   id	N4   No_Light	FC
  6   6   010600   id	N4   No_Light	FC
  7   7   010700   id	N4   No_Light	FC
  8   8   010800   id	N4   Online	  FC  F-Port  21:00:00:24:ff:33:68:6a
  9   9   010900   id	N4   Online	  FC  F-Port  21:00:00:24:ff:33:68:6b
10  10   010a00   id	N4   No_Light	FC
11  11   010b00   id	N4   No_Light	FC
12  12   010c00   id	N4   No_Light	FC
13  13   010d00   --	N4   No_Module   FC
14  14   010e00   id	N4   Online	  FC  F-Port  21:00:00:1b:32:9a:fe:9a
15  15   010f00   id	N4   Online	  FC  F-Port  21:01:00:1b:32:ba:fe:9a
16  16   011000   id	N4   Online	  FC  F-Port  21:00:00:1b:32:9a:5b:a0
17  17   011100   id	N4   No_Light	FC
18  18   011200   --	N4   No_Module   FC
19  19   011300   --	N4   No_Module   FC
20  20   011400   id	N4   No_Light	FC
21  21   011500   id	N4   No_Light	FC
22  22   011600   --	N4   No_Module   FC
23  23   011700   --	N4   No_Module   FC
24  24   011800   --	N4   No_Module   FC  (No POD License) Disabled
25  25   011900   --	N4   No_Module   FC  (No POD License) Disabled
26  26   011a00   --	N4   No_Module   FC  (No POD License) Disabled
27  27   011b00   --	N4   No_Module   FC  (No POD License) Disabled
28  28   011c00   --	N4   No_Module   FC  (No POD License) Disabled
29  29   011d00   --	N4   No_Module   FC  (No POD License) Disabled
30  30   011e00   --	N4   No_Module   FC  (No POD License) Disabled
31  31   011f00   --	N4   No_Module   FC  (No POD License) Disabled

Switch name server output follows:

Code:

Fabric_A:root> nsshow -t
{
Type Pid	COS	 PortName				NodeName				 TTL(sec)
N	010000;	  3;21:00:00:1b:32:0a:bd:e0;20:00:00:1b:32:0a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:00:00:05:1e:03:78:99
	Permanent Port Name: 21:00:00:1b:32:0a:bd:e0
	Device type: Physical Initiator
	Port Index: 0
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010001;	  3;22:00:00:1b:32:0a:bd:e0;20:00:00:1b:32:0a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:00:00:05:1e:03:78:99
	Permanent Port Name: 21:00:00:1b:32:0a:bd:e0
	Device type: NPIV Target
	Port Index: 0
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010002;	  3;23:00:00:1b:32:0a:bd:e0;20:00:00:1b:32:0a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:00:00:05:1e:03:78:99
	Permanent Port Name: 21:00:00:1b:32:0a:bd:e0
	Device type: NPIV Target
	Port Index: 0
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010003;	  3;24:00:00:1b:32:0a:bd:e0;20:00:00:1b:32:0a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:00:00:05:1e:03:78:99
	Permanent Port Name: 21:00:00:1b:32:0a:bd:e0
	Device type: NPIV Target
	Port Index: 0
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010004;	  3;25:00:00:1b:32:0a:bd:e0;20:00:00:1b:32:0a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:00:00:05:1e:03:78:99
	Permanent Port Name: 21:00:00:1b:32:0a:bd:e0
	Device type: NPIV Target
	Port Index: 0
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010100;	  3;21:01:00:1b:32:2a:bd:e0;20:00:00:1b:32:2a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:01:00:05:1e:03:78:99
	Permanent Port Name: 21:01:00:1b:32:2a:bd:e0
	Device type: Physical Initiator
	Port Index: 1
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010101;	  3;22:01:00:1b:32:2a:bd:e0;20:00:00:1b:32:2a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:01:00:05:1e:03:78:99
	Permanent Port Name: 21:01:00:1b:32:2a:bd:e0
	Device type: NPIV Target
	Port Index: 1
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010102;	  3;23:01:00:1b:32:2a:bd:e0;20:00:00:1b:32:2a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:01:00:05:1e:03:78:99
	Permanent Port Name: 21:01:00:1b:32:2a:bd:e0
	Device type: NPIV Target
	Port Index: 1
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010103;	  3;24:01:00:1b:32:2a:bd:e0;20:00:00:1b:32:2a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:01:00:05:1e:03:78:99
	Permanent Port Name: 21:01:00:1b:32:2a:bd:e0
	Device type: NPIV Target
	Port Index: 1
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010104;	  3;25:01:00:1b:32:2a:bd:e0;20:00:00:1b:32:2a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:01:00:05:1e:03:78:99
	Permanent Port Name: 21:01:00:1b:32:2a:bd:e0
	Device type: NPIV Target
	Port Index: 1
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010200;	  3;21:02:00:1b:32:4a:bd:e0;20:00:00:1b:32:4a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:02:00:05:1e:03:78:99
	Permanent Port Name: 21:02:00:1b:32:4a:bd:e0
	Device type: Physical Initiator
	Port Index: 2
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010201;	  3;22:02:00:1b:32:4a:bd:e0;20:00:00:1b:32:4a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:02:00:05:1e:03:78:99
	Permanent Port Name: 21:02:00:1b:32:4a:bd:e0
	Device type: NPIV Target
	Port Index: 2
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010202;	  3;23:02:00:1b:32:4a:bd:e0;20:00:00:1b:32:4a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:02:00:05:1e:03:78:99
	Permanent Port Name: 21:02:00:1b:32:4a:bd:e0
	Device type: NPIV Target
	Port Index: 2
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010203;	  3;24:02:00:1b:32:4a:bd:e0;20:00:00:1b:32:4a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:02:00:05:1e:03:78:99
	Permanent Port Name: 21:02:00:1b:32:4a:bd:e0
	Device type: NPIV Target
	Port Index: 2
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010204;	  3;25:02:00:1b:32:4a:bd:e0;20:00:00:1b:32:4a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:02:00:05:1e:03:78:99
	Permanent Port Name: 21:02:00:1b:32:4a:bd:e0
	Device type: NPIV Target
	Port Index: 2
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010300;	  3;21:03:00:1b:32:6a:bd:e0;20:00:00:1b:32:6a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:03:00:05:1e:03:78:99
	Permanent Port Name: 21:03:00:1b:32:6a:bd:e0
	Device type: Physical Initiator
	Port Index: 3
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010301;	  3;22:03:00:1b:32:6a:bd:e0;20:00:00:1b:32:6a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:03:00:05:1e:03:78:99
	Permanent Port Name: 21:03:00:1b:32:6a:bd:e0
	Device type: NPIV Target
	Port Index: 3
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010302;	  3;23:03:00:1b:32:6a:bd:e0;20:00:00:1b:32:6a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:03:00:05:1e:03:78:99
	Permanent Port Name: 21:03:00:1b:32:6a:bd:e0
	Device type: NPIV Target
	Port Index: 3
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010303;	  3;24:03:00:1b:32:6a:bd:e0;20:00:00:1b:32:6a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:03:00:05:1e:03:78:99
	Permanent Port Name: 21:03:00:1b:32:6a:bd:e0
	Device type: NPIV Target
	Port Index: 3
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010304;	  3;25:03:00:1b:32:6a:bd:e0;20:00:00:1b:32:6a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:03:00:05:1e:03:78:99
	Permanent Port Name: 21:03:00:1b:32:6a:bd:e0
	Device type: NPIV Target
	Port Index: 3
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010400;	  3;50:01:10:a0:01:28:9a:9c;50:01:10:a0:01:28:9a:9e; na
	FC4s: FCP
	PortSymb: [51] "HP Ultrium 4 Fibre Channel S/N-HU19034P25 Port-0   "
	NodeSymb: [47] "HP Ultrium 4 Fibre Channel H46Z S/N-HU19034P25 "
	Fabric Port Name: 20:04:00:05:1e:03:78:99
	Permanent Port Name: 50:01:10:a0:01:28:9a:9c
	Device type: Physical Target
	Port Index: 4
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010800;	  3;21:00:00:24:ff:33:68:6a;20:00:00:24:ff:33:68:6a; na
	FC4s: FCP
	NodeSymb: [33] "QLE2462 FW:v8.01.02 DVR:v2.1.24.0"
	Fabric Port Name: 20:08:00:05:1e:03:78:99
	Permanent Port Name: 21:00:00:24:ff:33:68:6a
	Device type: Physical Initiator
	Port Index: 8
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010900;	  3;21:00:00:24:ff:33:68:6b;20:00:00:24:ff:33:68:6b; na
	FC4s: FCP
	NodeSymb: [33] "QLE2462 FW:v8.01.02 DVR:v2.1.24.0"
	Fabric Port Name: 20:09:00:05:1e:03:78:99
	Permanent Port Name: 21:00:00:24:ff:33:68:6b
	Device type: Physical Initiator
	Port Index: 9
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010e00;	  3;21:00:00:1b:32:9a:fe:9a;20:00:00:1b:32:9a:fe:9a; na
	Fabric Port Name: 20:0e:00:05:1e:03:78:99
	Permanent Port Name: 21:00:00:1b:32:9a:fe:9a
	Device type: Physical Initiator
	Port Index: 14
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	010f00;	  3;21:01:00:1b:32:ba:fe:9a;20:01:00:1b:32:ba:fe:9a; na
	Fabric Port Name: 20:0f:00:05:1e:03:78:99
	Permanent Port Name: 21:01:00:1b:32:ba:fe:9a
	Device type: Physical Initiator
	Port Index: 15
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
N	011000;	  3;21:00:00:1b:32:9a:5b:a0;20:00:00:1b:32:9a:5b:a0; na
	FC4s: FCP
	NodeSymb: [32] "QLE2462 FW:v4.06.01 DVR:v9.1.8.6"
	Fabric Port Name: 20:10:00:05:1e:03:78:99
	Permanent Port Name: 21:00:00:1b:32:9a:5b:a0
	Device type: Physical Initiator
	Port Index: 16
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No
The Local Name Server has 26 entries }
Fabric_A:root>

Here's what I'm running:

Code:

# uname -a
FreeBSD cadence.kennel.dognet.org 10.3-RELEASE-p7 FreeBSD 10.3-RELEASE-p7 #19 r305899: Sat Sep 17 13:07:22 EDT 2016	 john@cadence.kennel.dognet.org:/usr/obj/usr/src/sys/CADENCE  amd64

Here is the relevant CTL port listings:

Code:

# sysctl -a |grep isp |grep role
Port Online Frontend Name	 pp vp
0	YES	ioctl	ioctl	0  0
1	YES	tpc	  tpc	  0  0
2	NO	 camsim   camsim   0  0  naa.5000000bae755b03
3	NO	 camtgt   isp0	 0  0
4	YES	camtgt   isp0	 1  0  naa.2202001b324abde0
5	YES	camtgt   isp0	 2  0  naa.2302001b324abde0
6	YES	camtgt   isp0	 3  0  naa.2402001b324abde0
7	YES	camtgt   isp0	 4  0  naa.2502001b324abde0
8	NO	 camtgt   isp0	 5  0
9	NO	 camtgt   isp0	 6  0
10   NO	 camtgt   isp0	 7  0
11   NO	 camtgt   isp0	 8  0
12   NO	 camtgt   isp1	 0  0
13   YES	camtgt   isp1	 1  0  naa.2203001b326abde0
14   YES	camtgt   isp1	 2  0  naa.2303001b326abde0
15   YES	camtgt   isp1	 3  0  naa.2403001b326abde0
16   YES	camtgt   isp1	 4  0  naa.2503001b326abde0
17   NO	 camtgt   isp1	 5  0
18   NO	 camtgt   isp1	 6  0
19   NO	 camtgt   isp1	 7  0
20   NO	 camtgt   isp1	 8  0
21   NO	 camtgt   isp2	 0  0
22   YES	camtgt   isp2	 1  0  naa.2200001b320abde0
23   YES	camtgt   isp2	 2  0  naa.2300001b320abde0
24   YES	camtgt   isp2	 3  0  naa.2400001b320abde0
25   YES	camtgt   isp2	 4  0  naa.2500001b320abde0
26   NO	 camtgt   isp2	 5  0
27   NO	 camtgt   isp2	 6  0
28   NO	 camtgt   isp2	 7  0
29   NO	 camtgt   isp2	 8  0
30   NO	 camtgt   isp3	 0  0
31   YES	camtgt   isp3	 1  0  naa.2201001b322abde0
32   YES	camtgt   isp3	 2  0  naa.2301001b322abde0
33   YES	camtgt   isp3	 3  0  naa.2401001b322abde0
34   YES	camtgt   isp3	 4  0  naa.2501001b322abde0
35   NO	 camtgt   isp3	 5  0
36   NO	 camtgt   isp3	 6  0
37   NO	 camtgt   isp3	 7  0
38   NO	 camtgt   isp3	 8  0

QLogic ISP instance roles:

Code:

# sysctl -a |grep isp |grep role
dev.isp.3.chan8.role: 0
dev.isp.3.chan7.role: 0
dev.isp.3.chan6.role: 0
dev.isp.3.chan5.role: 0
dev.isp.3.chan4.role: 1
dev.isp.3.chan3.role: 1
dev.isp.3.chan2.role: 1
dev.isp.3.chan1.role: 1
dev.isp.3.role: 2
dev.isp.2.chan8.role: 0
dev.isp.2.chan7.role: 0
dev.isp.2.chan6.role: 0
dev.isp.2.chan5.role: 0
dev.isp.2.chan4.role: 1
dev.isp.2.chan3.role: 1
dev.isp.2.chan2.role: 1
dev.isp.2.chan1.role: 1
dev.isp.2.role: 2
dev.isp.1.chan8.role: 0
dev.isp.1.chan7.role: 0
dev.isp.1.chan6.role: 0
dev.isp.1.chan5.role: 0
dev.isp.1.chan4.role: 1
dev.isp.1.chan3.role: 1
dev.isp.1.chan2.role: 1
dev.isp.1.chan1.role: 1
dev.isp.1.role: 2
dev.isp.0.chan8.role: 0
dev.isp.0.chan7.role: 0
dev.isp.0.chan6.role: 0
dev.isp.0.chan5.role: 0
dev.isp.0.chan4.role: 1
dev.isp.0.chan3.role: 1
dev.isp.0.chan2.role: 1
dev.isp.0.chan1.role: 1
dev.isp.0.role: 2

Snippet of /etc/ctl.conf with the target which is zoned to the workstation in question via the second virtual port on each of the FC adapters on the server:

Code:

target naa.50015178f369f091 {
		auth-group no-authentication

		port isp0/2
		port isp1/2
		port isp2/2
		port isp3/2
		lun 0 {
				path /dev/zvol/sas15k/TashaFCWin10x64C2D
				device-id 50015178f369f191
				option vendor "FreeBSD"
				option product "TashaFCWin10x64C"
				option naa 50015178f369f191
				serial 102
		}
}

 

[IAPro]

Workstation QLogic adapter info:

Here are the adapter settings that apply:

Here is the tape drive showing up in BIOS but no FreeBSD hosted CTL target:

Here is the CentOS install that I PXE booted on the same workstation, it sees all 8 paths to the CTL hosted target:

 

[IAPro]

So, to answer your question, here is a name service entry for one of the CTL ports:

Code:

N	010001;	  3;22:00:00:1b:32:0a:bd:e0;20:00:00:1b:32:0a:bd:e0; na
	FC4s: FCP
	Fabric Port Name: 20:00:00:05:1e:03:78:99
	Permanent Port Name: 21:00:00:1b:32:0a:bd:e0
	Device type: NPIV Target
	Port Index: 0
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No

And here is the entry for the LTO drive:

Code:

N	010400;	  3;50:01:10:a0:01:28:9a:9c;50:01:10:a0:01:28:9a:9e; na
	FC4s: FCP
	PortSymb: [51] "HP Ultrium 4 Fibre Channel S/N-HU19034P25 Port-0   "
	NodeSymb: [47] "HP Ultrium 4 Fibre Channel H46Z S/N-HU19034P25 "
	Fabric Port Name: 20:04:00:05:1e:03:78:99
	Permanent Port Name: 50:01:10:a0:01:28:9a:9c
	Device type: Physical Target
	Port Index: 4
	Share Area: No
	Device Shared in Other AD: No
	Redirect: No
	Partial: No

The only differences I can see is that the LTO drive has additional "PortSymb" and "NodeSymb" information, and of course the "Device type" is different.

Is it possible I just have something misconfigured even though it shows up OK to Windows, Linux and VMware ESXi?

 

[mav@]

That is odd. "PortSymb" and "NodeSymb" should be set by modern versions of FreeNAS. Unfortunately in your logs provided there is no early connection handling stages including name server registration.

Another oddity is that in your first logs provided switch reports only 2 or 3 ports registered, all of which are ports of the FreeNAS itself. Make sure that you have switch zoning set correctly. Though that indeed does not explain why CentOS sees the target.

 

[IAPro]

OK, I might be causing confusion. Paulswansea was the OP, I guess I hijacked his (old) thread. This was the only thread I could find anywhere that described what appears to be exactly the same problem.

I am running FreeBSD 10.3p7, which has presumably the same CTL code.

Also the connect logs were submitted by the OP. I can try to get the same logs from my system if it would help.

I was also thinking of unconfiguring the NPIV stuff and turning zoning off just for troubleshooting but need to schedule downtime for that (or dig some other hardware to try to duplicate the problem with).

Is it worth it to set up a quick test bed in your opinion? Would be easier to get logs, reconfigure, etc.

 

[mav@]

I am running FreeBSD 10.3p7, which has presumably the same CTL code.

FreeNAS does not hold for 10.3-RELEASE, periodically updating to 10-STABLE. So the code may not be the same. At least symbolic names were added after FreeBSD 10.3-RELEASE.

 

[IAPro]

Interesting, I'm going to try building a test bed with latest FreeNAS and see if I can duplicate. The NPIV code is obviously in FreeBSD 10.3 at least so it's not ancient. If I can or can't duplicate hopefully it's useful to the community.

 

[Snail]

Hello,

Did you figure out the origin of your problem ?

I am facing the exact same scenario where the qlogic bios can not see the LUNs, while the operating system can.
The exceptions are that I am running FreeBSD 11.0-RELEASE-p10 and am not using NPIV.

There is no problem without the fc switch ( IBM TotalStorage SAN16B-2, which is equivalent to the brocade 200E).

 

[Ken Kirchner]

Is this a common configuration? I've never heard of anyone running iSCSI over an FC network. Are you doing it to try and leverage the 4Gb connectivity of your FC HBA vs a 1Gb ethernet?

 

[Snail]

Hello.

Not at all.
As you know, CTL allows to create iscsi LUNs, but it can also create FC LUNs.
That is what i am trying to do.

 

[Snail]

For information, I tried another solution (based on linux SCST) to ensure my configuration ( zoning, cabling etc) was right and it seems to be, as, in this case, the LUNs could be seen in the operation system and in the qlogic bios. .
I may be misconfiguring the /etc/ctl.conf config file. So could someone please show a an example of a working configuration?
I tried to use the example found in "man ctl.conf" but the problem still occured.

 

[IAPro]

Yes, I'd still like to see a solution to this problem, the added information that Linux SCST works properly does seem to point to CTL...

To be honest, I'm not sure when I can get to trying to duplicate the problem with alternate hardware, but we're definitely not trying to use iSCSI over FC, this is pure FC from the CTL.

Here is the snippet from my ctl.conf:

Code:

target naa.50015178f369f092 {
		auth-group no-authentication

		port isp0/3
		port isp1/3
		port isp2/3
		port isp3/3
		lun 0 {
				path /dev/zvol/sas15k/MayhemFCvSphere1950Boot
				#unmap=on
				device-id 50015178f369f192
				option vendor "FreeBSD"
				option product "MayhemFCvSphere1"
				#option revision "0123"
				option naa 50015178f369f192
				serial 103
		}
}