Asked by:
How good is Windows Server network stack scaling?

Question
-
Hello,
We are looking for a benchmarks showing how scalable Windows Server TCP/IP stack is on hundreds of CPU cores, specifically on the latest AMD CPU EPYC multicores.
What's the overall number of mpps we could expect from both single cores and multiple cores - how good Windows Server network stack scales towards 256 CPU cores on multiqueue NICs using multiple(if needed) IOCPs?
We assume WS2019 is capable to handle 100gbe NIC?
We are asking this questions because unfortunately there are no public benchmarks available.
P.S. We are planning to use RIO+IOCP(multiple NUMA-bound queues if needed to further scale)
Thank youWednesday, June 17, 2020 3:52 PM
All replies
-
This tool might help.
https://gallery.technet.microsoft.com/NTttcp-Version-528-Now-f8b12769
Regards, Dave Patrick ....
Microsoft Certified Professional
Microsoft MVP [Windows Server] Datacenter Management
Disclaimer: This posting is provided "AS IS" with no warranties or guarantees, and confers no rights.Wednesday, June 17, 2020 8:41 PM -
Hey Dave - thanks for the link!
We know already that WS network stack scales fine towards like 8..16 cores compared to other OSs but what about 256 cores? (2x 128 core threads EPYC processors). Just want to avoid unexpected surprises here...
We do not have access to this sort of hardware right now but will have in the future, while having to begin with app implementation in the next few weeks and buying expensive hardware just for tests is a bit overkill.
I wish the test from the link were updated with the latest 100GBe cards on a high end server capable of saturating them.
- Edited by Dmitrii__ Wednesday, June 17, 2020 9:46 PM
Wednesday, June 17, 2020 9:41 PM -
Who's hardware are you buying? They should have done some testing.
Regards, Dave Patrick ....
Microsoft Certified Professional
Microsoft MVP [Windows Server] Datacenter Management
Disclaimer: This posting is provided "AS IS" with no warranties or guarantees, and confers no rights.Wednesday, June 17, 2020 9:49 PM -
> Who's hardware are you buying? They should have done some testing.
PowerEdge R6525 + 100GBe(Mellanox?). No tests provided by Dell... Overall mem bandwidth (around 500GB/sec) and CPU performance should be capable of saturating 100GBe NICs with tens of millions of pps.
We want to consolidate network app on one performant server instead of balancing it on the farm of mediocre level ones.
Wednesday, June 17, 2020 10:01 PM -
Found at least something:
http://developer.amd.com/wp-content/resources/56288_1.00.pdf
But still no info on Mpps...Wednesday, June 17, 2020 11:42 PM -
Hi,
Sorry to reply to you now. It seem there is no specific documents about Windows Server 2019 network stack scaling. Based on my research, these links may give you some help:
Windows Server supported networking scenarios:
https://docs.microsoft.com/en-us/windows-server/networking/windows-server-supported-networking-scenarios#nic-teaming-scenarios
NIC Teaming and settings:
https://docs.microsoft.com/en-us/windows-server/networking/technologies/nic-teaming/nic-teaming
https://docs.microsoft.com/en-us/windows-server/networking/technologies/nic-teaming/nic-teaming-settingsHope these are useful to you.
Best regards,
Cherry
Please remember to mark the replies as answers if they help.
If you have feedback for TechNet Subscriber Support, contact tnmff@microsoft.com.- Proposed as answer by CherryZhang2020Microsoft contingent staff Monday, June 29, 2020 1:32 AM
Thursday, June 18, 2020 5:49 AM -
Hi,
Just want to confirm the current situations.
Please feel free to let us know if you need further assistance.
Best Regards,
Cherry
Please remember to mark the replies as answers if they help.
If you have feedback for TechNet Subscriber Support, contact tnmff@microsoft.com.Monday, June 22, 2020 2:47 AM -
Hi,
Just checking in to see if the information provided was helpful. Please let us know if you would like further assistance.
Best Regards,
CherryPlease remember to mark the replies as answers if they help.
If you have feedback for TechNet Subscriber Support, contact tnmff@microsoft.com.Wednesday, June 24, 2020 4:57 AM -
Hi,
As this thread has been quiet for a while, we will mark it as ‘Answered’ as the information provided should be helpful. If you need further help, please feel free to reply this post directly so we will be notified to follow it up. You can also choose to unmark the answer as you wish.
BTW, we’d love to hear your feedback about the solution. By sharing your experience you can help other community members facing similar problems. Thanks for your understanding and efforts.
Best regards,
Cherry
Please remember to mark the replies as answers if they help.
If you have feedback for TechNet Subscriber Support, contact tnmff@microsoft.com.Monday, June 29, 2020 1:32 AM