Looks like a lot of opinions have been shared already, and some very good opinions I might add
Here's my 2 cents worth: It really depends on what your goals with programming are. I'd say learn it. Why not? It's out there, it's used a lot in businesses via MS Access 2007 and Excel 2007. I use it a lot at work for handling small scripts and such.
If you're going into software development as a career, obviously you're going to want to be well versed in as many computer languages as possible. I suppose if you're not pursuing programming professionally and you're trying to be as efficient with your time and money as possible, that would be a consideration for focusing on another language vs. VB, like c/c++, java or perl, etc.
Good luck, and have fun learning whatever you decide on!