Starting!

First of all, install linux on your computer!!! Ubuntu is great! It's stable, easy and full of features.
Then go to

http://www.arduino.cc/playground/Linux/Ubuntu

and follow the instructions to install the software for your Arduino.
After all done you'll have everything needed to start your projects!