Deprecating cache utilities (removal in 3.6.0)

[simonbasle]

Motivation

CacheMono and CacheFlux helpers were an attempt at providing a sane solution to adapt various cache / means of caching into a reactive facade.

There is very little bandwidth to maintain it, and it seems it is not entirely helpful. Maybe even going as far as causing more problems than it solves.

See for example #162, #181, #201 (and recently closed #234...)

When using a caching solution like https://github.com/ben-manes/caffeine that has a future-based async API, we can recommend to just wrap the futures using Mono#toFuture() and Mono.fromFuture(f).

For other use cases for CacheFlux I could find in the wild the path would be a bit more ambiguous.

A few relevant projects that build up on CacheFlux/CacheMono I could find in github include:

• https://github.com/deeperunderstanding/reactive-cache-poc (backed by Redis)
• https://github.com/Odysseymoon/spring-webflux-template
• https://github.com/alex-pumpkin/reactor-lock
• https://github.com/rezaarshad/Spring-Webflux-Cache (sample to do reactive caching on top of GuaveCache)
• https://github.com/pkgonan/reactor-cache (support @EnableCaching spring annotation backed by CacheMono)
• https://github.com/hotire/reactor-utils/ has a ReactiveCacheManager wrapping spring's Cache and CacheManager
• https://github.com/making/functional-spring-cookbook has an entry on using CacheMono with a map and caffeine
• https://github.com/mmaggioni/reactive-cache seems to be a spring-webflux oriented solution providing an annotation on top of CacheMono
• https://github.com/spring-cloud/spring-cloud-gateway/ uses CacheFlux in the CachingRouteLocator (backed by a ConcurrentHashMap)

Desired solution

One of the following outcomes:

1. gather feedback indicating that although it has shortcomings (eg. cache stampeding), it is useful for usecases that are not too advanced and should be kept as is, in low maintenance mode
2. get a community member to step up and spin CacheFlux/CacheMono into a separate community-supported project, deprecate reactor.cache classes in favor of said community project
3. gather feedback that the drawbacks of CacheFlux/CacheMono overcome the benefits, deprecate reactor.cache classes for future removal

pinging the owners of the above projects for feedback:
@deeperunderstanding, @Odysseymoon, @alex-pumpkin, @rezaarshad, @pkgonan, @Hothire, @making, @mmaggioni, @spencergibb.

also pinging users that contributed to discussions in the above issues:
@dave-fl, @cybuch, @wer-mathurin, @ben-manes, @hmble2, @dannyjiang001

[wer-mathurin]

My understanding from this article:

We are not able to use our loved caching annotations when working with custom cache-manager, because the serialization of the class is required and Mono/Flux are not serializable.

Is there any plan to support the caching annotation in the future when working with webflux?
If this is not the case, we just need to specify it in the documentation!

Louis-Michel

[simonbasle]

My understanding from this article:

Thanks for chiming in @wer-mathurin ! There is indeed a missing piece in the cache abstraction, but one caveat I could gather from looking at these various projects and issues is that unless the backing cache provider supports async use cases (and especially async write-through), it is going to be difficult to come up with a reliable abstraction (like CacheMono) because the async nature of the writes mean that the caching becomes even more subject to cache stampedes.

From what I can gather, there isn't a whole lot of caches that provide async APIs (basically, Caffeine). Off-memory distributed caches might have an even greater challenge in supporting this. My guess is that this is why no AsyncCache abstraction has been officially pursued in the Spring ecosystem yet.

[simonbasle]

We've decided to phase out these utilities for the reasons mentioned above.
Both CacheFlux and CacheMono will be deprecated in the next release of 3.4.x (3.4.7) and removed in 3.6.0 at the earliest.