A new version 4.3.3 of IOS has just been released. This seems to include the issue with storing your location.
Here's the fix :
This update contains the changes to the iOS Crowd-Sourced location database cache.
- Reduces the size of the cache
- No longer backs up the cache to Itunes
- Deletes the cache entirely with Location Services is turned off.