TPC-C, SAP-SD, and SPECjbb2005
SPEC CPU is an interesting test for all types of processor tasks, but there's more to life than pure maths. A common server task is running some type of database, and TPC-C is a benchmark that is often used as a measure for database performance. The test simulates the business processes of a distributor with multiple offices and hundreds of thousands of customers and products. Performance is measured in the number of transaction per minute. Since the test is sensitive to differences in the speed of the storage systems used as well as memory, a price/performance rating is given to make clear when a manufacturer ups his score artificially by investing a couple of million in hard disks. What isn't reflected in the score is the operating systems and database packages used; these may be chosen freely. Itanium and Power get their best scores running Oracle under HP-UX and running DB2 under AIX, while the x86 chips get tested pretty much exclusively running SQL Server under Windows.
It turns out that Clovertown has the best performance as well as the best price/performance ratio of all two socket servers, but it does not measure up against the big boys with four. The Opteron does not convince at first sight, but whoever takes the absolute prices into consideration instead of performance per dollar, will note that the AMD machines are the cheapest. Incidentally, the same version of SQL Server (64 bit) was used to obtain the Opteron and Clovertown scores. Woodcrest, Dempsey, and Tulsa lack SP1, which might put them at a slight disadvantage.
SAP-SD (Sales & Distribution) is a similar benchmark in that it also simulates business processes, but rather than transactions per minute, it is the number of users that can work on the system simultaneously, that is given as the final score. As the name indicates, this test is aimed more at the well known ERP package than on the underlying database, but that is not to say that it is not sensitive to factors outside the processor.
Unfortunately, prices may not be listed along with the test results. What we can do instead is check the CPU loads to see whether the system was pushed to its limit. In virtually all cases the load is above 95%, with the exception of the four-way Paxville. This means that the processor was a limiting factor in the rest of the results, and there would be little point in adding extra hard disks or memory. Here, too, we see Intel's come-back: the performance for two sockets has been more than doubled and for four has increased by more than half - enough to overtake the Opteron in both cases.
The last business benchmark is SPECjbb2005, that simulates a triple layer architecture which emphasizes the middle one, the so-called 'business logic', in which all XML processing and such takes place. The test was written entirely in Java, so the performance of the virtual machine is at least as important as that of the software itself. The score is expressed in BOPS - business operations per second. And again, Clovertown dominates with a score that even four-socket systems cannot get close to.
It turns out that Clovertown has the best performance as well as the best price/performance ratio of all two socket servers, but it does not measure up against the big boys with four. The Opteron does not convince at first sight, but whoever takes the absolute prices into consideration instead of performance per dollar, will note that the AMD machines are the cheapest. Incidentally, the same version of SQL Server (64 bit) was used to obtain the Opteron and Clovertown scores. Woodcrest, Dempsey, and Tulsa lack SP1, which might put them at a slight disadvantage.
| Power5 | 4 | 1,9GHz | ||||||||
| Itanium 2 9050 | 4 | 1,6GHz | Montecito | |||||||
| Xeon MP 7140 | 4 | 3,4GHz | Tulsa | |||||||
| Opteron 8220 | 4 | 2,8GHz | Santa Rosa | |||||||
| Xeon MP 7041 | 4 | 3,0GHz | Paxville | |||||||
| 2 | 2,66GHz | Clovertown | ||||||||
| Itanium 2 9050 | 2 | 1,6GHz | Montecito | |||||||
| Power5 | 2 | 1,9GHz | ||||||||
| Xeon 5160 | 2 | 3,0GHz | Woodcrest | |||||||
| Opteron 2220 | 2 | 2,8GHz | Santa Rosa | |||||||
| Xeon 5080 | 2 | 3,73GHz | Demspey | |||||||
SAP-SD (Sales & Distribution) is a similar benchmark in that it also simulates business processes, but rather than transactions per minute, it is the number of users that can work on the system simultaneously, that is given as the final score. As the name indicates, this test is aimed more at the well known ERP package than on the underlying database, but that is not to say that it is not sensitive to factors outside the processor.
Unfortunately, prices may not be listed along with the test results. What we can do instead is check the CPU loads to see whether the system was pushed to its limit. In virtually all cases the load is above 95%, with the exception of the four-way Paxville. This means that the processor was a limiting factor in the rest of the results, and there would be little point in adding extra hard disks or memory. Here, too, we see Intel's come-back: the performance for two sockets has been more than doubled and for four has increased by more than half - enough to overtake the Opteron in both cases.
| Itanium 2 9050 | 4 | 1,6GHz | Montecito | |||||||
| Xeon MP 7140 | 4 | 3,4GHz | Tulsa | |||||||
| Opteron 2280 | 4 | 2,8GHz | Santa Rosa | |||||||
| Xeon MP 7041 | 4 | 3,0GHz | Paxville | |||||||
| 2 | 2,66GHz | Clovertown | ||||||||
| Xeon 5160 | 2 | 3,0GHz | Woodcrest | |||||||
| Opteron 2218 | 2 | 2,6GHz | Santa Rosa | |||||||
| Xeon 5080 | 2 | 3,73GHz | Demspey | |||||||
| Xeon DC | 2 | 2,8GHz | Paxville | |||||||
The last business benchmark is SPECjbb2005, that simulates a triple layer architecture which emphasizes the middle one, the so-called 'business logic', in which all XML processing and such takes place. The test was written entirely in Java, so the performance of the virtual machine is at least as important as that of the software itself. The score is expressed in BOPS - business operations per second. And again, Clovertown dominates with a score that even four-socket systems cannot get close to.
| Xeon MP 7140 | 4 | 3,4GHz | Tulsa | |||||||
| Opteron 8220 | 4 | 2,8GHz | Santa Rosa | |||||||
| Itanium 2 9050 | 4 | 1,6GHz | Montecito | |||||||
| Power5+ | 4 | 1,65GHz | ||||||||
| 2 | 2,66GHz | Clovertown | ||||||||
| Xeon 5160 | 2 | 3,0GHz | Woodcrest | |||||||
| Opteron 2220 | 2 | 2,8GHz | Santa Rosa | |||||||
| Xeon 5080 | 2 | 3,73GHz | Dempsey | |||||||
| Power5+ | 2 | 1,65GHz | ||||||||
| Xeon DC | 2 | 2,8GHz | Paxville | |||||||
| UltraSparc T1 | 1 | 1,2GHz | Niagara | |||||||
Next page (SPECweb2005 and summery - 4/8)
