BLUEDOG314
Cadet
- Joined
- Jul 10, 2019
- Messages
- 4
Hi. I was wondering if anyone wouldn't mind spot checking a system I plan building. Use case is a machine that will ingest various types of scans in a lab setting along with storing long (12-24hr) video files. There is probably about 15-20TB of historical scans that need to be imported, but after that the rate at which they will be generated new is not a lot, probably 1-2TB/year at most. There are no historical video files to be imported, but once they start being generated we are talking probably 50GB per day intake but after quick review roughly half of that will be deleted same day. The rest will stay for further review and medium term storage of maybe a year at most. This system will back up to another file server to be archived and doesn't need to hold this data "forever". The goal is to basically have any "recent" data, say anything less than 2 years old, be available very quickly to machines in the lab. It won't be uncommon to need to pull 50-70GB of data from the server to a workstation for analysis/review each day.
I can try to add a diagram later if this isn't clear, but the lab will have this system, an analysis workstation, and an offline laptop connected to a clinical scanner. The laptop will not be on the internet but needs to get scans quickly to the server. The workstation will do most of the data juggling from and to the server as it has to analyze scans and initially download the video recordings and push/pull them from the server as needed. The server must also be available on the broader network (university setting) via SMB, and I may try out NextCloud if it can satisfy the needs for light file transfers for collaborators.
My thought was the laptop would get an adapter (still looking into these for quality) to do thunderbolt 3 to SPF+ and direct connect to the server. The workstation would also direct connect to the server via SFP+ and also have a regular 1Gbe internet connection. The server connects to both lab computers with SFP+ and has its own 1Gbe internet connection.
After reading the hardware guides here and the iXSystems ZFS storage pool layout guide I thought I would do the following and track down some older hardware built around a consumer CPU:
Supermicro X11SCH-F
Seasonic Focus SGX-650 Watt
Fractal Node 804
2x 32GB Samsung DDR4-2666 ECC RAM
6 Seagate IronWolf Pro 20TB drives in one RAIDZ2 vdev
A 4-pack of 10GTek SFP+ tranceivers (not much thought into these, but seemed to be highly compatible and work well)
2x Chelsio T520-CR adapters
2x Samsung 970Evo mirrored for boot
Will need to find a TB3 to SFP+ adapter
Have plenty of OM3 and OM4 cables laying around so shouldn't need to buy.
One question I had was will I need to/should I (I think I saw that it is possible but could totally be making this up) change the transaction group size or timeout time to correspond to the estimated write speed of the pool considering if the laptop adapter pans out both it and the workstation will feed the server from a fast SSD?
Sorry for the long post but thank you, and thoughts very much appreciated!
I can try to add a diagram later if this isn't clear, but the lab will have this system, an analysis workstation, and an offline laptop connected to a clinical scanner. The laptop will not be on the internet but needs to get scans quickly to the server. The workstation will do most of the data juggling from and to the server as it has to analyze scans and initially download the video recordings and push/pull them from the server as needed. The server must also be available on the broader network (university setting) via SMB, and I may try out NextCloud if it can satisfy the needs for light file transfers for collaborators.
My thought was the laptop would get an adapter (still looking into these for quality) to do thunderbolt 3 to SPF+ and direct connect to the server. The workstation would also direct connect to the server via SFP+ and also have a regular 1Gbe internet connection. The server connects to both lab computers with SFP+ and has its own 1Gbe internet connection.
After reading the hardware guides here and the iXSystems ZFS storage pool layout guide I thought I would do the following and track down some older hardware built around a consumer CPU:
Supermicro X11SCH-F
Seasonic Focus SGX-650 Watt
Fractal Node 804
2x 32GB Samsung DDR4-2666 ECC RAM
6 Seagate IronWolf Pro 20TB drives in one RAIDZ2 vdev
A 4-pack of 10GTek SFP+ tranceivers (not much thought into these, but seemed to be highly compatible and work well)
2x Chelsio T520-CR adapters
2x Samsung 970Evo mirrored for boot
Will need to find a TB3 to SFP+ adapter
Have plenty of OM3 and OM4 cables laying around so shouldn't need to buy.
One question I had was will I need to/should I (I think I saw that it is possible but could totally be making this up) change the transaction group size or timeout time to correspond to the estimated write speed of the pool considering if the laptop adapter pans out both it and the workstation will feed the server from a fast SSD?
Sorry for the long post but thank you, and thoughts very much appreciated!