Short version If you are having problems with nuget packages and think it might be related to local caching delete packages from these directories -
%LocalAppData%\NuGet\Cache and %userprofile%\.nuget\packages\
Long version I was making nuget package, lets call it Foo, for my own use, not one that I was going to distribute publicly, but I was putting in on MyGet.