SOLVED ipmitool not working

[AVSION]

Hi Guys, . i'm running ESXi 6.7 with FN VM 11.2 U3 and trying to set the FAN threshold using ipmitool but its not working i get an error

Code:

root@freenas[/]# ipmitool
Could not open device at /dev/ipmi0 or /dev/ipmi/0 or /dev/ipmidev/0: No such file or directory

in directory /dev/ ipmi device is missing, but the driver is loaded

Code:

root@freenas ~]# find / -name "ipmitool"
/usr/local/bin/ipmitool
/usr/local/share/ipmitool
[root@freenas ~]# kldload ipmi
kldload: can't load ipmi: module already loaded or in kernel
[root@freenas ~]# dmesg | grep -i ipmi
[root@freenas ~]# dmidecode | grep -i ipmi
[root@freenas ~]# kldload ipmi.ko
kldload: can't load ipmi.ko: module already loaded or in kernel
[root@freenas ~]# kldstat
Id Refs Address            Size     Name
1   73 0xffffffff80200000 251f110  kernel
2    1 0xffffffff82721000 100eb0   ispfw.ko
3    1 0xffffffff82822000 f9f8     ipmi.ko
4    2 0xffffffff82832000 2d28     smbus.ko
5    1 0xffffffff82835000 8a10     freenas_sysctl.ko
6    1 0xffffffff82a19000 32e048   vmm.ko
7    1 0xffffffff82d48000 a74      nmdm.ko
8    1 0xffffffff82d49000 e610     geom_mirror.ko
9    1 0xffffffff82d58000 3a3c     geom_multipath.ko
10    1 0xffffffff82d5c000 2ec      dtraceall.ko
11    9 0xffffffff82d5d000 3acf8    dtrace.ko
12    1 0xffffffff82d98000 5b8      dtmalloc.ko
13    1 0xffffffff82d99000 1898     dtnfscl.ko
14    1 0xffffffff82d9b000 1d31     fbt.ko
15    1 0xffffffff82d9d000 53390    fasttrap.ko
16    1 0xffffffff82df1000 bfc      sdt.ko
17    1 0xffffffff82df2000 6d80     systrace.ko
18    1 0xffffffff82df9000 6d48     systrace_freebsd32.ko
19    1 0xffffffff82e00000 f9c      profile.ko
20    1 0xffffffff82e01000 13ec0    hwpmc.ko
21    1 0xffffffff82e15000 7340     t3_tom.ko
22    2 0xffffffff82e1d000 ab8      toecore.ko
23    1 0xffffffff82e1e000 ddac     t4_tom.ko
24    1 0xffffffff82e2c000 2798     vmmemctl.ko
25    1 0xffffffff82e2f000 23e0     vmxnet.ko
26    1 0xffffffff82e32000 2d08     vmblock.ko
27    1 0xffffffff82e35000 17a0     uhid.ko
[root@freenas ~]#

as well no problem accessing the IPMI web UI all normal can make any changes just ipmitool on freenas not available

please help, is there anyway to test where the issues is and how to fix it/workaround?

Thank you

 

[Chris Moore]

as well no problem accessing the IPMI web UI all normal can make any changes just ipmitool on freenas not available

Is FreeNAS running inside a VM? If yes, it is isolated by the hyper-visor and not able to reach the physical hardware.

 

[AVSION]

Hi @Chris Moore, Yes it is runing inside VM, any other way to access the ipmi to change the FAN settings?
Cheers

 

[jgreco]

Hi @Chris Moore, Yes it is runing inside VM, any other way to access the ipmi to change the FAN settings?
Cheers

1) Contact the IPMI interface across the network (you know, the way IPMI is intended to work)

or

2) Reboot FreeNAS on the physical hardware and then repeat what you tried

or

3) Install the ESXi IPMI tools and then repeat what you tried from ESXi

 

[AVSION]

Thanks, option 3 sounds appealing, i have ubuntu VM running as well on ESXi, i have installed ipmitools but it didn't work got similar error. i just found an old thread, will that work? or do you know of more updated guide?

http://blog.rchapman.org/posts/Configuring_BMC_or_iDRAC_from_ESXi_or_Linux/

 

[jgreco]

No, I'm sorry, I generally run IPMI over the network because that's a necessary capability in our production environment. The third option was included as I suspected it might be easiest for you, and because I've seen precompiled versions floating around the net in the past. You'll have to do your own homework, sorry! ;-)

 

[droeders]

1) Contact the IPMI interface across the network (you know, the way IPMI is intended to work)

Not to hijack this thread, but don't you keep your IPMI networks separate from operational LANs?

I keep my IPMI devices on a separate VLAN with no connections to routers, and which is only reachable from a workstation or two on the L2. I do this to prevent outbound access from the IPMI devices, as well as preventing non-admin users from even attempting to access them.

3) Install the ESXi IPMI tools and then repeat what you tried from ESXi

I've seen questions similar to the OP in the past, but I don't think I've seen these ESXi tools mentioned. Thanks for pointing those out.

 

[Chris Moore]

Not to hijack this thread, but don't you keep your IPMI networks separate from operational LANs?

Some people do, some people don't, it just depends on the network. Many home users will have both on the same network.

 

[jgreco]

Not to hijack this thread, but don't you keep your IPMI networks separate from operational LANs?

We're a service provider network here. Having an unreachable IPMI network is not useful or practical, because the reason for IPMI is to be able to manage systems (it's actually the "M" in IPMI). Hiring remote hands at data centers hundreds or thousands of miles away for the sorts of things people routinely do via IPMI is both expensive and impractical. Remote hands are okay when the problem is "power cycle machine named FOO" or "replace hard drive labeled BAR". But imagine trying to explain to them how to install IPMIview to make complex modifications to a converged hypervisor platform that's developed some strange problem.

There are numerous ways to segment networks to balance practicality and security, and that's an interesting discussion to have. In the old days, we often ran separate OOB management networks, but with modern ubiquitous IP networking, it is no longer cost-conscious to run cross-country pointopoint 56K or T1 circuits. Most networks don't really do this anymore for a variety of reasons. It's probably sufficient to segment your network with proper firewalling and control of end-to-end visibility.

For example, our engineering workstations don't have Internet access. I get my Internet access here by VNC to VM's. Most of those VM's are behind a UTM. If you pull up a browser on my workstation, it can't reach Google or CNN or whatever. It can, however, reach the various datacenter management networks, which is where the hypervisors live, which is why I can pull up a VM console.

There's over a hundred separate IP networks running at this site alone. Some of them may be legacy with just a few things hanging around. It's not hard to segment your AS.

 

[droeders]

Thanks for the real-world insight as always. There are many around here that appreciate it.

I have similar constraints with networks I use for work, but they are very strict with access to infrastructure machines. As you said, there are many ways to divide this stuff up, and the trade-offs make it interesting.

 

[AVSION]

Hi Guys,

Sorry for my late reply busy on a school project deploying an AVoIP system and school network.
Thank you for your help, i fixed it. i use iMac as my main machine, and was able to install ipmitool on my iMac using brew, all the rest was as usual, my Fans now is on 500rpm, see below process.

Code:

name-iMac% brew install ipmitool
Updating Homebrew...
==> Auto-updated Homebrew!
Updated 2 taps (homebrew/core and homebrew/cask).
==> New Formulae
allureofthestars  boringtun         cfn-lint          cpp-gsl           cubelib           cypher-shell      itk               ktlint            leela-zero        otf2              scws
==> Updated Formulae
cmake ✔                  cpprestsdk               gcc@7                    gst-rtsp-server          libchamplain             minio                    pre-commit               sonobuoy
glances ✔                crowdin                  gegl                     gstreamer                libcoap                  minio-mc                 presto                   subversion
nano ✔                   crystal                  gel                      gtranslator              libdap                   mkvtoolnix               prometheus               swagger-codegen
ammonite-repl            crystal-icr              getdns                   hebcal                   libebml                  mosquitto                pspg                     swagger-codegen@2
ansifilter               dartsim                  ghc                      hugo                     libedit                  mps-youtube              psql2csv                 tcpreplay
apache-geode             dfmt                     gifsicle                 imagemagick              libestr                  msmtp                    pulumi                   teleport
apache-spark             docfx                    git-lfs                  imagemagick@6            libetonyek               nagios                   purescript               terrahub
aravis                   doctl                    gitfs                    ios-sim                  libfabric                netdata                  py3cairo                 tmux
argyll-cms               emscripten               gitlab-runner            isl                      libfixbuf                newsboat                 pygobject3               tmuxinator-completion
asciidoctor              epubcheck                gitless                  joplin                   libgit2                  nghttp2                  qalculate-gtk            tundra
aws-iam-authenticator    erlang                   glooctl                  jump                     libgit2-glib             node-build               qbs                      typescript
aws-sdk-cpp              erlang@20                glslang                  kitchen-sync             libjson-rpc-cpp          node@8                   qemu                     ultralist
azure-cli                ethereum                 gmsh                     kyoto-cabinet            liblinear                numpy                    r                        v8
bash                     exploitdb                golang-migrate           kyoto-tycoon             libltc                   octave                   restic                   varnish
binaryen                 ffmpeg                   gopass                   laszip                   libmatroska              odpi                     rke                      vault
bind                     firebase-cli             goreleaser               latex2html               libphonenumber           opencoarrays             roll                     vcdimager
blast                    flow                     gradle                   latexml                  libqalculate             paket                    rsyslog                  vim
carla                    fn                       grafana                  lbdb                     librealsense             parallel                 ruby-build               vte3
certbot                  freetds                  groovysdk                lcdf-typetools           libressl                 passenger                rust                     vtk
chakra                   frps                     gst-editing-services     lego                     lmod                     pcapplusplus             rustup-init              wp-cli
chronograf               frugal                   gst-libav                lgogdownloader           lynis                    pcl                      salt                     wtf
clang-format             galen                    gst-plugins-bad          libb2                    lz4                      pdal                     serverless               yaf
cockroach                gauge                    gst-plugins-base         libbluray                maxwell                  pdnsrec                  shfmt                    youtube-dl
cogl                     gcc                      gst-plugins-good         libcddb                  media-info               picard-tools             ship
cointop                  gcc@5                    gst-plugins-ugly         libcdio                  meson                    pijul                    silk
conan                    gcc@6                    gst-python               libcdr                   mingw-w64                platformio               sn0int


name-iMac% ipmitool -H 1.2.3.4 -U xxxx -P xxxxxx sensor thresh FAN1 lower 100 200 300
Locating sensor record 'FAN1'...
Setting sensor "FAN1" Lower Non-Recoverable threshold to 100.000
Setting sensor "FAN1" Lower Critical threshold to 200.000
Setting sensor "FAN1" Lower Non-Critical threshold to 300.000
name-iMac% ipmitool -H 1.2.3.4 -U xxxx -P xxxxxx sensor thresh FAN1 upper 1600 1700 1800
Locating sensor record 'FAN1'...
Setting sensor "FAN1" Upper Non-Critical threshold to 1600.000
Setting sensor "FAN1" Upper Critical threshold to 1700.000
Setting sensor "FAN1" Upper Non-Recoverable threshold to 1800.000
name-iMac% ipmitool -H 1.2.3.4 -U xxxx -P xxxxxx sensor thresh FAN2 lower 100 200 300 
Locating sensor record 'FAN2'...
Setting sensor "FAN2" Lower Non-Recoverable threshold to 100.000
Setting sensor "FAN2" Lower Critical threshold to 200.000
Setting sensor "FAN2" Lower Non-Critical threshold to 300.000
name-iMac% ipmitool -H 1.2.3.4 -U xxxx -P xxxxxx sensor thresh FAN2 upper 1600 1700 1800
Locating sensor record 'FAN2'...
Setting sensor "FAN2" Upper Non-Critical threshold to 1600.000
Setting sensor "FAN2" Upper Critical threshold to 1700.000
Setting sensor "FAN2" Upper Non-Recoverable threshold to 1800.000


name-iMac% ipmitool -H 1.2.3.4 -U xxxx -P xxxxxx sensor list       
CPU Temp         | 40.000     | degrees C  | ok    | 0.000     | 0.000     | 0.000     | 87.000    | 92.000    | 92.000   
PCH Temp         | 52.000     | degrees C  | ok    | 0.000     | 5.000     | 16.000    | 90.000    | 95.000    | 100.000   
System Temp      | 36.000     | degrees C  | ok    | -10.000   | -5.000    | 0.000     | 80.000    | 85.000    | 90.000   
Peripheral Temp  | 43.000     | degrees C  | ok    | -10.000   | -5.000    | 0.000     | 80.000    | 85.000    | 90.000   
VcpuVRM Temp     | 48.000     | degrees C  | ok    | -5.000    | 0.000     | 5.000     | 95.000    | 100.000   | 105.000   
VmemABVRM Temp   | 45.000     | degrees C  | ok    | -5.000    | 0.000     | 5.000     | 95.000    | 100.000   | 105.000   
VmemCDVRM Temp   | 35.000     | degrees C  | ok    | -5.000    | 0.000     | 5.000     | 95.000    | 100.000   | 105.000   
DIMMA1 Temp      | 46.000     | degrees C  | ok    | -5.000    | 0.000     | 5.000     | 80.000    | 85.000    | 90.000   
DIMMA2 Temp      | na         |            | na    | na        | na        | na        | na        | na        | na       
DIMMB1 Temp      | 44.000     | degrees C  | ok    | -5.000    | 0.000     | 5.000     | 80.000    | 85.000    | 90.000   
DIMMB2 Temp      | na         |            | na    | na        | na        | na        | na        | na        | na       
DIMMC1 Temp      | na         |            | na    | na        | na        | na        | na        | na        | na       
DIMMC2 Temp      | na         |            | na    | na        | na        | na        | na        | na        | na       
DIMMD1 Temp      | na         |            | na    | na        | na        | na        | na        | na        | na       
DIMMD2 Temp      | na         |            | na    | na        | na        | na        | na        | na        | na       
FAN1             | 700.000    | RPM        | ok    | 100.000   | 200.000   | 300.000   | 1600.000  | 1700.000  | 1800.000 
FAN2             | 800.000    | RPM        | ok    | 100.000   | 200.000   | 300.000   | 1600.000  | 1700.000  | 1800.000 
FAN3             | na         |            | na    | na        | na        | na        | na        | na        | na       
FAN4             | na         |            | na    | na        | na        | na        | na        | na        | na       
FAN5             | na         |            | na    | na        | na        | na        | na        | na        | na       
FANA             | na         |            | na    | na        | na        | na        | na        | na        | na       
12V              | 12.126     | Volts      | ok    | 10.173    | 10.299    | 10.740    | 12.945    | 13.260    | 13.386   
5VCC             | 5.000      | Volts      | ok    | 4.246     | 4.298     | 4.480     | 5.390     | 5.546     | 5.598     
3.3VCC           | 3.316      | Volts      | ok    | 2.789     | 2.823     | 2.959     | 3.554     | 3.656     | 3.690     
VBAT             | 3.187      | Volts      | ok    | 2.375     | 2.487     | 2.599     | 3.775     | 3.887     | 3.999     
Vcpu             | 1.836      | Volts      | ok    | 1.242     | 1.260     | 1.395     | 1.899     | 2.088     | 2.106     
VDIMMAB          | 1.209      | Volts      | ok    | 0.948     | 0.975     | 1.047     | 1.344     | 1.425     | 1.443     
VDIMMCD          | 1.209      | Volts      | ok    | 0.948     | 0.975     | 1.047     | 1.344     | 1.425     | 1.443     
5VSB             | 4.974      | Volts      | ok    | 4.246     | 4.298     | 4.480     | 5.390     | 5.546     | 5.598     
3.3VSB           | 3.316      | Volts      | ok    | 2.789     | 2.823     | 2.959     | 3.554     | 3.656     | 3.690     
1.5V PCH         | 1.527      | Volts      | ok    | 1.320     | 1.347     | 1.401     | 1.644     | 1.671     | 1.698     
1.2V BMC         | 1.227      | Volts      | ok    | 1.020     | 1.047     | 1.092     | 1.344     | 1.371     | 1.398     
1.05V PCH        | 1.059      | Volts      | ok    | 0.870     | 0.897     | 0.942     | 1.194     | 1.221     | 1.248     
Chassis Intru    | 0x0        | discrete   | 0x0000| na        | na        | na        | na        | na        | na       


name-iMac% ipmitool -H 1.2.3.4 -U xxxx -P xxxxxx bmc reset cold
Sent cold reset command to MC


name-iMac% ipmitool -H 1.2.3.4 -U xxxx -P xxxxxx sensor list   
CPU Temp         | 40.000     | degrees C  | ok    | 0.000     | 0.000     | 0.000     | 87.000    | 92.000    | 92.000   
PCH Temp         | 51.000     | degrees C  | ok    | 0.000     | 5.000     | 16.000    | 90.000    | 95.000    | 100.000   
System Temp      | 35.000     | degrees C  | ok    | -10.000   | -5.000    | 0.000     | 80.000    | 85.000    | 90.000   
Peripheral Temp  | 42.000     | degrees C  | ok    | -10.000   | -5.000    | 0.000     | 80.000    | 85.000    | 90.000   
VcpuVRM Temp     | 48.000     | degrees C  | ok    | -5.000    | 0.000     | 5.000     | 95.000    | 100.000   | 105.000   
VmemABVRM Temp   | 44.000     | degrees C  | ok    | -5.000    | 0.000     | 5.000     | 95.000    | 100.000   | 105.000   
VmemCDVRM Temp   | 34.000     | degrees C  | ok    | -5.000    | 0.000     | 5.000     | 95.000    | 100.000   | 105.000   
DIMMA1 Temp      | 44.000     | degrees C  | ok    | -5.000    | 0.000     | 5.000     | 80.000    | 85.000    | 90.000   
DIMMA2 Temp      | na         |            | na    | na        | na        | na        | na        | na        | na       
DIMMB1 Temp      | 42.000     | degrees C  | ok    | -5.000    | 0.000     | 5.000     | 80.000    | 85.000    | 90.000   
DIMMB2 Temp      | na         |            | na    | na        | na        | na        | na        | na        | na       
DIMMC1 Temp      | na         |            | na    | na        | na        | na        | na        | na        | na       
DIMMC2 Temp      | na         |            | na    | na        | na        | na        | na        | na        | na       
DIMMD1 Temp      | na         |            | na    | na        | na        | na        | na        | na        | na       
DIMMD2 Temp      | na         |            | na    | na        | na        | na        | na        | na        | na       
FAN1             | 500.000    | RPM        | ok    | 100.000   | 200.000   | 300.000   | 1600.000  | 1700.000  | 1800.000 
FAN2             | 500.000    | RPM        | ok    | 100.000   | 200.000   | 300.000   | 1600.000  | 1700.000  | 1800.000 
FAN3             | na         |            | na    | na        | na        | na        | na        | na        | na       
FAN4             | na         |            | na    | na        | na        | na        | na        | na        | na       
FAN5             | na         |            | na    | na        | na        | na        | na        | na        | na       
FANA             | na         |            | na    | na        | na        | na        | na        | na        | na       
12V              | 12.126     | Volts      | ok    | 10.173    | 10.299    | 10.740    | 12.945    | 13.260    | 13.386   
5VCC             | 5.000      | Volts      | ok    | 4.246     | 4.298     | 4.480     | 5.390     | 5.546     | 5.598     
3.3VCC           | 3.316      | Volts      | ok    | 2.789     | 2.823     | 2.959     | 3.554     | 3.656     | 3.690     
VBAT             | 3.187      | Volts      | ok    | 2.375     | 2.487     | 2.599     | 3.775     | 3.887     | 3.999     
Vcpu             | 1.836      | Volts      | ok    | 1.242     | 1.260     | 1.395     | 1.899     | 2.088     | 2.106     
VDIMMAB          | 1.209      | Volts      | ok    | 0.948     | 0.975     | 1.047     | 1.344     | 1.425     | 1.443     
VDIMMCD          | 1.209      | Volts      | ok    | 0.948     | 0.975     | 1.047     | 1.344     | 1.425     | 1.443     
5VSB             | 4.974      | Volts      | ok    | 4.246     | 4.298     | 4.480     | 5.390     | 5.546     | 5.598     
3.3VSB           | 3.316      | Volts      | ok    | 2.789     | 2.823     | 2.959     | 3.554     | 3.656     | 3.690     
1.5V PCH         | 1.527      | Volts      | ok    | 1.320     | 1.347     | 1.401     | 1.644     | 1.671     | 1.698     
1.2V BMC         | 1.227      | Volts      | ok    | 1.020     | 1.047     | 1.092     | 1.344     | 1.371     | 1.398     
1.05V PCH        | 1.059      | Volts      | ok    | 0.870     | 0.897     | 0.942     | 1.194     | 1.221     | 1.248     
Chassis Intru    | 0x0        | discrete   | 0x0000| na        | na        | na        | na        | na        | na       
name-iMac%