I don't think so
You need to look at so many variables, it's not likely to be that you're in a workgroup or that there are 14 users.
How much memory does your server have? CPU, RAID 0,1, 5 onboard or dedicated.
Is your server configured for BACKGROUND SERVICESS OR PROGRAMS? Open system manager, advanced, advanced.
Use perfmon to analyze your memory, hard drive, page/swap file for problems.
If one drive in your system has a bad block your computer can be constantly scrubbing the drive to find out what the correct data is. Open start, diskmgmt.msc, are they healthy?
Open task manager, click on the second to last tab, NETWORKING, you'll see that there is almost no traffic. I run a 50gb copy from one GB Nic to another and the performance doesn't die. In fact it can't be saturated from a single 7200 rpm drive to the next as the GB can handle a higher throughput.
What does your network topology look like? Are you using a decent switch or older hub. BTW - my experience Jumbo frames on GB don't make hardly any difference.
Segment the network, is the performance still bad on those users. When performance is bad, is the server crying? Is your network that dependent on the servers drives or basically just a file server?
Update the drivers on your NIC. The one that comes with Windows is for compatibility, not performance. Go to the manufacturers website for updated drivers.
As a side note, make sure your 2003 is updated to SP 2, and perhaps your XP computers have SP3. Probably won't make much of a difference though.
Check for virus'. The conficker virus can totally dibilitate a network, it did mine.
Hope that gives you enough ideas?
Jake