How to read a JSON or CSV document from memory?

[not-my-profile]

The format-specific read_ methods form SessionContext only accept paths, so I am wondering how you can instead provide something that implements std::io::Read.

Apparently back in 5.0.0 there were some try_new_from_reader methods but they have been removed and I am struggling to figure out how to do the same with the new API.

[alamb]

the idea is that you would implement something that implemented the ObjectStore trait and then read a "path" from that

Here is an example of one that does so for in memory blobs https://docs.rs/object_store/0.6.1/object_store/memory/struct.InMemory.html

[Jefffrey]

This is indeed a limitation of DataFusion at the moment. I'll close this discussion in favour of the issue opened to track this: #18802