Web Framework Comparison Benchmark Specification

Project Specification

Hi, I am a final year student in Software Development in the Institute of Technology Carlow, Ireland. For my final year project I decided to try and provide a way for people to choose their web framework for their application in an unbiased way.

I decided to start with two web frameworks; Chicago Boss and Ruby on Rails. Chicago Boss is a web framework built on top of the Erlang programming language and Ruby on Rails is a web framework built on top of the Ruby programming language.

The first step will be building the same series of applications on both web frameworks. Next, I will be comparing the performance of these applications on both web frameworks with testing tools, such as JMeter and Tsung to get a benchmark for both web frameworks.

The series of applications that I have developed are available on GitHub along with the procedure I used to build them. The first is a simple blog application built in both Chicago Boss and Ruby on Rails.

Chicago Boss version:

https://github.com/archerydwd/cb_blog

Ruby on Rails version:

https://github.com/archerydwd/ror_blog

The second is an application that I built around an existing MySQL database including some large tables.

Chicago Boss version:

https://github.com/archerydwd/cb_sakila

Ruby on Rails version:

https://github.com/archerydwd/ror_sakila

So far I have built the applications and currently I'm in the process of learning Tsung and JMeter (or any other tools that I come across of any use). Once I have learnt the testing tools, I will provide the tests that I have run on the above applications along with a tutorial for using them. If all goes well I will expand the web frameworks I am using to include some more such as Flask.

To use the benchmarks that I will be providing you should develop the series of applications that I have created in your chosen web framework. Implement my tests and compare your results with my benchmarks. 
This should provide you with an unbiased way to choose a web framework.

Thanks for reading!

Darren Daly.