I bought my VSTs, but you can also get some really good free ones from music magazines. In the UK we have Computer Music which always gives fantastic free VSTs away - if you're not from the UK then keep an eye out for any magazines with them local to you.
As for drums, you will find a ton of free ones online but the quality varies drastically and most of them you will regret using when you learn how to mix properly. There are some fantastic websites out there offering well mixed drums for all kinds of styles of music. Just Google.
As a cheap plug, I offer free beat tags if you buy drums from those websites using my link - it doesn't cost you any extra and the tags are free if you do: http://tagyourbeats.com/drum-kits/
You'll assemble a good number of sounds as time goes on.
google, youtube, other producers sound kits and vsts, And dont be afraid to buy sounds if you can afford some cheapy packs. Every other producer is also looking for free shit so when you buy something you increase your chances of finding unique sounds that arent over used!