/VFIO Increments
VFIO Increments2019-06-19T17:35:52+00:00

VFIO Increments

One of the most common questions we get is: “how should I build a VFIO PC?”

Admittedly, this is a pretty hard question to answer, which is why we created this page. This table contains a coherent list of parts for VFIO-focused builds at different price ranges. The FAQ section below includes information on the rationale in choosing these parts, as well as workarounds you’ll need to do depending on what you choose to buy (components that need workarounds are signposted with asterisks.)

We constructed it in the hopes that it becomes a go-to reference for the passthrough community. It takes a lot of time and effort to maintain, so if you like the fact that we keep it up to date, consider supporting us on Patreon.

 

 

TierCPUCoolingMotherboardGuest GPUHost GPUMemoryPSUSSDHDDCasePrice
Bargain BinIntel i3-8100StockGigabyte B360M DS3H *EVGA 1660 GamingIntel UHD 63016GB DDR4 2133SeaSonic S12III 80+ 450W120GB3TBCorsair 100R$600+
Intel i5-8400Contac Silent 12ASRock Z390 Pro4 *EVGA 1660 Ti XC Black Gaming16GB DDR4 2400Seasonic S12III 80+ 550W1TBCorsair 200R
FSP Hyper M 80+ Bronze 550WRosewill Tyrfing
Low-Mid EndIntel i5-9400StockASRock Z390 Pro4 *EVGA 1660 Ti XC Black GamingIntel UHD 63016GB DDR4 2400Seasonic S12III 80+ 550W480GB4TBCorsair 200R$900+
Intel i5-9600kContac Silent 12Gigabyte z390 UD*MSI RTX 2060 Ventus32GB DDR4 2133Seasonic S12III 80+ 650W1TB4TBCiT Falcon
Pure Rock SlimMSI z370 PC Pro*FSP Hyper M 80+ Bronze 650WZalman S2
Mid-EndIntel i7-8700Pure Rock SlimASRock Z390 Pro4 *MSI RTX 2060 VentusIntel UHD 63032GB DDR4 2133Seasonic S12III 80+ 650W1TB6TBCorsair 200R$1,200+
Intel i7-8700KHyper 212 EvoGigabyte z390 UD*EVGA RTX 2070 Gaming Black32GB DDR4 2400FSP Hyper M 80+ Bronze 650W2x 1TBCorsair 270R
Intel i7-9700KPure RockMSI z370 PC Pro*16GB DDR4 2666-3200Super Flower Leadex PlatinumCooler Master Masterbox NR400
Mid-High EndAMD TR 1900XNoctua NH-U14S TR4GB X399 Aorus ProMSI RTX 2060 VentusMSI GT 71016GB DDR4 3200 B-Die ***Seasonic FOCUS 80+ Gold 850W1TB2x 6TBCorsair 270R$1,600+
AMD TR 2920XDark Rock Pro TR4ASRock X399 TaichiEVGA RTX 2070 Gaming Black32GB 2400 B Die ***FSP Twins Dual Redundant PSUCorsair 300R
Intel i9-9900KNoctua NH-D15(s)ASRock Z390 Taichi *EVGA RTX 2070 Gaming BlackIntel UHD 63032GB DDR4 2400FSP Hydro Plus Platinum 750W1TB2x 6TBCorsair 450D
Dark Rock ProGB Aorus Master z390 *Thermaltake Core X71
High EndAMD TR 2950XDark Rock Pro TR4GB X399 Aorus ProEVGA RTX 2070 Gaming BlackMSI GT 71032GB DDR4 2666-3200Seasonic Flagship Prime Platinum 1200W1TB + NVMe2x 6TBCorsair 450D$2,000+
Cooler Master Wraith RipperGigabyte Windforce 208064GB DDR4 2666-3200FSP PT 80+ Platinum 1000W NVMe3x 6TBCorsair 540 AIR
Intel i9-9900XNoctua NH-D15 (s)Gigabyte X299 UD4Gigabyte Windforce 2080MSI GT 71032GB DDR4 2666-3200Seasonic Flagship Prime Gold 1300W NVMe3x 6TBCorsair 750D AIR
Intel i9-7940XDark Rock ProMSI X299 RaiderGigabyte 1080 Ti Windforce64GB DDR4 2666-3200 2x 1TB + NVMeCorsair AIR 740
Cooler Master HAF XB EVO
Overkill/Multi-GuestIntel i9-7960XNH-D15 (s)MSI X299 Pro Carbon 1-4+ Gigabyte 1080 Ti WindforceMSI GT 71032GB DDR4 2666-3200FSP PT 80+ Platinum 1000W 2x 1TB
4x 6TBCorsair 750D AIR$3500+
Intel I9-7980XEDark Rock ProGigabyte X299 Designaire1-4+ Gigabyte 1080 Ti Waterforce64GB DDR4 2666-3200Seasonic 80+ Platinum 1000W3x 1TB + NVMeCorsair AIR 740
Custom WaterGigabyte X299 Wu81-4+ EVGA 2080 Ti Black128GB DDR4 2666-3200Seasonic SSR 80+ Platinum 1200WThermaltake Core W100
AMD TR 2970WXDark Rock Pro TR4MSI X399 SLI Plus1-4+ Gigabyte 1080 Ti WindforceMSI GT 71064GB DDR4 2666-3200Seasonic Flagship Prime Gold 1300W 2x 1TB4x 6TBCorsair AIR 740
AMD TR 2990WXCooler Master Wraith RipperGigabyte X399 Designaire1-4+ Gigabyte 1080 Ti Waterforce128GB DDR4 2666-3200FSP Cannon 92+ 2000W 2x 1TB + NVMe3x 6TBThermaltake Core W100
Custom WaterMSI x399 MEG1-4+ EVGA 2080 Ti Black

 

 

 

ADVISORY:  Basic Ryzen platforms have been removed from the increments chart because of a bug affecting UEFIs on AGESA 0.0.7.2 and later that completely breaks VFIO functionality, and prevents the user from downgrading. They will be Re-added as soon as this issue is resolved. AMD  GPUs increasingly carry the Reset Bug, and will only be added if we can validate a specific model across multiple guest VMs.

 

Is this hardware guide good for Mac OS?2019-06-13T16:41:20+00:00

Mostly, yes. However, OS X has much stricter requirements when it comes to Guest GPUs. You want to go with a 700 Series Nvidia card or an AMD card instead of the nvidia devices listed on the chart for best compatibility

This is because all future versions of OS X will lack driver support for new nvidia cards. Kepler is the last universally supported Architecture and 700 Series cards are the only ones that universally ship with UEFI boot support. Note also that the GT 745, 750 and 750 Ti won’t work because they’re rebranded maxwell devices. On the AMD side, anything older than Hawaii (R9 290/390) Will be reset bug free, but some polaris (RX 400 and 500) cards will also work. Vega and Fiji (Fury/Vega) cards seem most susceptible to the reset bug, so avoid those if possible.

What about Laptops?2019-06-13T04:25:20+00:00

Long story short, the vast majority of laptops don’t support passthrough, and even the ones that do make it incredibly painful to set up. Even then, not all guest operating systems will work, even if you can get it working for one of them.

There are 2 methodologies for enabling passthrough in Laptops:

E-GPU

Older laptops (or newer models that don’t have bios whitelisting) can attach a desktop GPU via the mPCIe or m.2 slot normally reserved for a wireless adapter or NVMe drive using a variety of adapters. These don’t typically give the full bandwidth needed for 100% baremetal performance but they’re the most compatible with traditional passthrough methods. Laptops that support expresscard or pcmcia also have this option available, but are usually too old to be relevant.

Thunderbolt laptops also have tentative support for this, but it varies by model.

Onboard DGPU

This category of passthrough is a lot more dependent on your laptop’s native hardware configuration. Older models with MXM based GPUs can work, but newer “optimus” models depend entirely on the implementation of their intel/nvidia GPU muxing.  If your bios does not support manual override of one GPU or the other, chances are it won’t work. If it does, and you have physical ports dedicated to the discrete gpu only, then you may be good to go with some extensive tweaking, but there’s no guarantees.

Search https://www.reddit.com/r/vfio with your Laptop’s model to find specifics.

Why isn’t [BRAND] represented on this page?2019-06-13T01:11:12+00:00

Most likely due to compatibility or quality control reasons. For some components, we just try to find the best price without venturing into unreliable territory, for others, it’s more complicated. We’ve listed reasons for popular ones below:

ASUS motherboards

The most recent releases from asus have had underwhelming build quality, and on AMD platforms, an issue with their UEFI tanks performance in VMs if you try to tweak certain power management settings. Their inclusion will change if these factors change.

WD/Seagate HDDs

Higher year over  year failure rates and price per GB than other brands.

Rebranded/Reseller PSUs

If your PSU isn’t from an ODM you have no way of telling how reputable the designer actually was. We feel that it’s worth the peace of mind to go with ODM brands if it means spending a little more.

AIO Water Coolers

Put simply, the cost and failure risk associated with these devices makes them hard to recommend. Most AIO systems, even ones somewhat more expensive than top end air coolers, perform the same as, or worse than air cooling, while introducing a lot of negatives. Custom water loops offer a real advantage because they typically have much more fluid (and therefore thermal capacity) as well as far more powerful pumps than your typical AIO water system. They also allow you to cool your GPUs more effectively while using them in a single slot configuration. You take away those advantages when you move into the AIO segment of products.

[INSERT CASE MANUFACTURER]

We prioritize airflow and construction quality over adolescent aesthetics and LED lighting when choosing cases for this page. If you need RGB, tempered glass, and restricted airflow because of the first two in your life, feel free to use a different case provided that it clears your chosen cooling solution

Power Supplies2019-06-13T00:31:21+00:00

A PSU can make, or quite literally, break your system. As such, we only list PSUs that come direct from reputable ODMs in the industry, with good track records in the enterprise market.

Sometimes you can find a better deal on a PSU via resellers or OEM rebrands. However, reseller brands (corsair, EVGA, etc.) release revisions and products in the same series from less reputable Shenzen designers, and navigating the details of this market can be a lot of trouble.

If you can find them, Seasonic, Super Flower, FSP, Channel Well, and Delta are the brands to look for.

Hard Disk Drives2019-06-13T01:18:00+00:00

It’s an HDD. Cheap, spins, keeps your data safe. You should have a few in your system unless you need absolutely silent computing for your recording studio, in which case I’m not sure why you’re here.

We like to recommend Toshiba and Hitachi HDDs over Seagate and WD, because the numbers from several wide spectrum evaluations put them at the lowest failure rates year over year (other than HGST, a subdivision of Hitachi that was bought out by  WD recently) and they’re also consistently cheaper per GB. We periodically update listings with best price/GB drives in the table above, so be sure to check back every once in a while if you’re looking for a bargain.

RAM2019-06-13T00:37:13+00:00

There’s not a whole lot to say about RAM.

Intel platforms will pretty much take whatever you slot in, and the amount you can pass to your VM is the only relevant metric to passthrough gaming.

AMD platforms will need to be vetted according to your motherboard’s compatibility list, and Samsung B-Die kits will generally perform better. Ryzen does scale a bit more dramatically with increased frequency due to the way it’s memory subsystem and CCX interconnects work, but as long as it’s listed as compatible you shouldn’t run into any issues. Generally, you want to buy the cheapest sticks you can find from a reputable brand.

[***] B-Die isn’t magic, it just tends to be more compatible with AMD platforms.

Host GPUs2019-06-13T00:38:21+00:00

This is the card that your host machine will use when your Gaming VM is up and running. Platforms with iGPUs don’t need an additional card, but Intel HEDT and AMD platforms will. If you need to drive a lot of monitors, do creative work, or want to game on your host in addition to your VM, feel free to get a higher powered card. We’ve chosen the GT 710 as a catch-all Host GPU because it can drive multiple monitors, and only costs around $40 USD.

 

Note: choosing the same model of card, or in some circumstances, even the same manufacturer as you use on your guest VM can cause problems. A good rule of thumb is to go with AMD on the host if you use Nvidia on your Gaming VM, and vice versa. While not 100% necessary, this will avoid complicated vfio-pci and modprobe configurations.

Guest GPUs2019-06-13T00:43:28+00:00

One of the most important parts of your build will be the guest GPU, and selecting one with high compatibility that fits your needs can be difficult. Here’s a quick rundown on what to look for.

What’s a Guest GPU?

It’s the graphics card that you pass over to your virtual machine to enable 3D acceleration and Gaming. Ideally you would be able to share it between the host and guest, but we don’t live in a perfect world, so you (with a few new and very expensive exceptions) need two GPUs, one for each OS. On systems with an iGPU, this means you only need to buy one discreet card, but on AMD and intel HEDT platforms, you’ll need a Host card as well.

Miners will buy up a lot of models as soon as they hit the shelves, so even highly compatible models tend to be scarce at a certain level of performance. Generally,  though, there are 2 routes you can take for effectively selecting a Guest GPU:

Nvidia — all the cards are “broken”

Luckily, they’re all broken in the same way. Nvidia’s drivers will abort with an error if you try loading them in a VM with a consumer card attached. There’s a well documented workaround though, and with 5 extra lines in your XML, you can get them up and running.The rule of thumb with consumer Nvidia cards is that they all work with a little tweaking, more or less.

You can also drop a lot more money on a quadro and skip editing your xml, but we don’t recommend it.

AMD — some work, some just plain don’t

AMD has no such driver restriction for their consumer cards, which means (at least in theory) that they should “just work.”  And a lot of them do. The trouble is, some of the AiB partners’ BIOS modifications don’t play well with KVM. A badly put together vBIOS can harm or even completely stop a passthrough gaming VM from working as intended. There are several bugs caused by this issue, that are collectively known as  “The AMD Reset Bug.” There are 2 levels of severity:

  • [*] Hang on Crash — The VM will work normally, but if it crashes during normal use, it will fail to reinitialize and will only become available again on system reboot. This is the less severe of the two levels, and may not affect the user at all if they aren’t overclocking or experiencing other  system instability.
  • [**] Hang on Reboot — The VM will work normally, but will fail to reinitialize after it is shut off, only becoming available when the host reboots. This level of the bug will make the card incredibly inconvenient to use for passthrough gaming.

There are workarounds that do work for some cards, but they aren’t as well documented or tested as the Nvidia Fixes, so we attempt to curate bug-free cards as best we can on this page.

Motherboards2019-06-14T15:37:12+00:00

Choosing the right motherboard is a twofold problem when it comes to VFIO. Not only do you need to carefully select for the right bios features and I/O, but you need to know how well the PCIe slots are isolated via IOMMU.

The problem is, no vendor lists the IOMMU layout on their boards, and the only information you can generally find is scattered in forum posts and may be years old. Furthermore, certain chipsets have quirks that, while known to community veterans, can stop newcomers in their tracks. Here, we provide personally (or in some cases community) vetted known working models for the range of products we recommend. If the part has issues that need working around, check the entry for asterisks, and reference them below.

UPDATE: as of AGESA 0.0.7.2 Mainstream Ryzen Motherboards Break VFIO entirely.

[*] – ACS needed in some cases: generally this workaround means that the board functions fine for regular use, but the cpu-specific lanes may not isolate properly. If you want a 2 dGPU build instead of using the iGPU or a chipset slot on these boards, the ACS Override Patch will generally be needed.

[**] – ACS needed in all cases: This board was chosen for price, not performance or compatibility. The IOMMU groups will not be functional for 1 GPU passthrough builds without the ACS patch.

[] – CSM Toggle/Slot Swap: For these boards, the CSM module needs to be turned on/off in the UEFI to allow the host gpu to work properly, or GPUs need to be rearranged so that the system designates the correct GPU for boot.

[] – EFIFB off: the efifb option needs to be disabled for the host GPU to boot properly from the chipset slot.

 


 

If you have known working new AMD GPUs, please contact us with your make, model and the severity of the reset bug, if present.

Price totals are approximate and subject to change with the market. Also, please read our Affiliate Link Disclaimer.