We've had a few requests for a notification system for updated extensions. I think we have an indication in the status bar if an extension fails to load, perhaps we can overload this and also show when new versions of extensions are available.
This would be a short term solution until we look at a richer in-product experience for discovering and managing extensions.