Yeah,
unfortunately, changing the language doesn't always work for everyone. I have been using DNN since version 2.0.4. The starter kit VS integration has always been sketchy. I have been griping about it for years.
I have resorted to setting up my projects manually. To do this, grab the Install download, unpack it to your new web root, configure your version of IIS (Works on IIS6 and IIS7) to serve the web root, create your database and database user if you are using SQL authentication, set the folder permissions on your web root to grant full access to the Network Service user, edit the connection string in the web.config to use your database and user, then browse to your new web root. Once there, follow the wizard to set up your portal.
Then once the site is up, open the site in VS (File=>Open=>Web Site...=> browse to and select my new web root folder => click open.)
I know it sounds like a lot, but it really only takes 5 minutes.
Hope this helps.
As a side note, I place all my sites in a folder called websites on my disk. I actually set the permissions on that folder and subfolders so I don't need to fuss with the folder permissions on every project I create.
Also note that if you are using XP, you may have to also grant these permissions to ASPNET, IWAM_MachineName, and IUSR_MachineName users.
Cheers!