01 Jul CS451 Project #1 Benchmarking, programming homework help
Question Description
CS451 Project #1
Benchmarking
Instructions:
Due date: 11:59PM on Monday, 02/03/14
Maximum Points: 100%
Maximum Extra Credit Points: 25%
You should work in teams of 2 for this assignment.
Please post your questions to the Piazza forum.
Only a softcopy submission is required; it must be submitted to “Digital Drop Box” on Blackboard.
For all programming assignments, please submit just the softcopy; please zip all files (report, source code, compilation scripts, and documentation) and submit it to BB.
Name your file as this rule: “PROJ#_LASTNAME1_LASTNAME2.{zip|tar|pdf}”. E.g. “Proj1_Doe_Smith.tar”.
Late submission will be penalized at 10% per day (beyond the 7-day late pass).
1 Your Assignment
This project aims to teach you how to benchmark different parts of a computer system, from the CPU, GPU, memory, disk, and network.
You can be creative with this project. You are free to use any programming languages (C, C++, Java, etc) and any abstractions such as sockets, threads, events, etc. that might be needed. You are free to use any machines for your development as long as it will work under Linux for your final evaluation.
In this project, you need to design a benchmarking program that covers four of the five components listed below; to get full credit, you need to implement just 4 components; the maximum extra credit you can get for this assignment is 25, although there are 50 extra possible points you could attempt:
1. CPU: Measure the processor speed, in terms of floating point operations per second (Giga FLOPS, 109 FLOPS) and integer operations per second (Giga IOPS, 109 IOPS); measure the processor speed at varying levels of concurrency (1 thread, 2 threads & 4 threads) 2*3 = 6 experiments
a. hint, modern processors can do multiple instructions per cycle, so make sure to give your benchmark good code to allow it to run multiple instructions concurrently
b. for 5% extra credit, vary the number of threads and find the optimal number of concurrency to get the best performance
2. GPU: Measure the GPU speed, in terms of floating point operations per second (Giga FLOPS, 109 FLOPS) and integer operations per second (Giga IOPS, 109 IOPS); measure the processor speed with full concurrency (mapping 1 thread per core) 2 experiments
a. Hint: You will have to use either CUDA or OpenCL to do this assignment; timing might also be tricky, compared to measuring timing on the host system
b. Make sure to make your GPU code generic, and not hard coded to match your specific GPU; the TAs will run your code on a GPU that might be different than your GPU, and your code must still be correct
c. For 5% extra credit, measure the read and write memory bandwidth of the GPU memory with different size messages (1B, 1KB, 1MB)
3. Memory: Measure the memory speed of your host; your parameter space should include read+write operations (e.g. memcpy), sequential access, random access, varying block sizes (1B, 1KB, 1MB), and varying the concurrency (1 thread & 2 threads). The metrics you should be measuring are throughput (Megabytes per second, MB/sec) and latency (milliseconds, ms) 1*2*3*2 = 12 experiments
a. hint: you are unlikely going to be able to do this benchmark in Java, while C/C++ is a natural language to implement this benchmark
b. for 5% extra credit, vary the number of threads and find the optimal number of concurrency to get the best performance
4. Disk: Measure the disk speed; your parameter space should include read operations, write operations, sequential access, random access, varying block sizes (1B, 1KB, 1MB, 1GB), and varying the concurrency (1 thread & 2 threads). The metrics you should be measuring are throughput (MB/sec) and latency (ms)
a. Hint: there are multiple ways to read and write to disk, explore the different APIs, and pick the fastest one out of all them 2*2*4*2 = 32 experiments
b. for 5% extra credit, vary the number of threads and find the optimal number of concurrency to get the best performance
5. Network: Measure the network speed in terms of bytes/second; your parameter space should include the loopback interface card (between 2 processes on the same node), the TCP protocol stack, UDP, varying packet/buffer size (1B, 1KB, 64KB), and varying the concurrency (1 thread & 2 threads). The metrics you should be measuring are throughput (Megabits per second, Mb/sec) and latency (ms) 1*2*3*2 = 12 experiments
a. for 5% extra credit, run the same experiments over a 1Gb/s Ethernet switch between two different systems
Other requirements:
You must write all benchmarks from scratch. You can use well known benchmarking software to verify your results, but you must implement your own benchmarks. Do not use code you find online, as you will get 0 credit for this assignment.
All of the benchmarks will have to evaluate concurrency performance; concurrency can be achieved using threads. Be aware of the thread synchronizing issues to avoid inconsistency or deadlock in your system.
All of these benchmarks could be done on a single machine, but for some network tests, you could use 2 machines.
Experiments should be done in such a way that they take multiple seconds to minutes to run, in order to amortize any startup costs of the experiments; that means that for some of the operations that are really small (e.g. 1B), you might need to do many thousands or even millions of them to run long enough to amortize the costs of the benchmark overheads.
Not all timing functions have the same accuracy; you must find one that has at least 1ms accuracy or better.
Since there are many experiments to run, find ways (e.g. scripts) to automate the performance evaluation.
Make sure your machine is idle when running the benchmarks as it would help to improve reliability and consistency of the results.
No GUIs are required. Simple command line interfaces are fine.
Our website has a team of professional writers who can help you write any of your homework. They will write your papers from scratch. We also have a team of editors just to make sure all papers are of HIGH QUALITY & PLAGIARISM FREE. To make an Order you only need to click Ask A Question and we will direct you to our Order Page at WriteDemy. Then fill Our Order Form with all your assignment instructions. Select your deadline and pay for your paper. You will get it few hours before your set deadline.
Fill in all the assignment paper details that are required in the order form with the standard information being the page count, deadline, academic level and type of paper. It is advisable to have this information at hand so that you can quickly fill in the necessary information needed in the form for the essay writer to be immediately assigned to your writing project. Make payment for the custom essay order to enable us to assign a suitable writer to your order. Payments are made through Paypal on a secured billing page. Finally, sit back and relax.
About Writedemy
We are a professional paper writing website. If you have searched a question and bumped into our website just know you are in the right place to get help in your coursework. We offer HIGH QUALITY & PLAGIARISM FREE Papers.
How It Works
To make an Order you only need to click on “Order Now” and we will direct you to our Order Page. Fill Our Order Form with all your assignment instructions. Select your deadline and pay for your paper. You will get it few hours before your set deadline.
Are there Discounts?
All new clients are eligible for 20% off in their first Order. Our payment method is safe and secure.