Error when mirroring data to BigQuery TypeError: Converting circular structure to JSON

[MrAlek]

[REQUIRED] Step 2: Describe your configuration

• Extension name: **firestore-bigquery-export
• Extension version: 0.1.2

[REQUIRED] Step 3: Describe the problem

After running the initial setup and upon changing a field on a document in Firestore, the ext-firestore-bigquery-export-fsexportbigquery ran with the following error:

Error when mirroring data to BigQuery TypeError: Converting circular structure to JSON
    at JSON.stringify (<anonymous>)
    at events.map (/srv/node_modules/@firebaseextensions/firestore-bigquery-change-tracker/lib/bigquery/index.js:64:36)
    at Array.map (<anonymous>)
    at FirestoreBigQueryEventHistoryTracker.<anonymous> (/srv/node_modules/@firebaseextensions/firestore-bigquery-change-tracker/lib/bigquery/index.js:56:33)
    at Generator.next (<anonymous>)
    at fulfilled (/srv/node_modules/@firebaseextensions/firestore-bigquery-change-tracker/lib/bigquery/index.js:20:58)
    at <anonymous>
    at process._tickDomainCallback (internal/process/next_tick.js:229:7)

This is the document for which the error occured:

[russellwheatley]

Hi @MrAlek, this is an interesting error. I've tried to recreate the circular reference dependency error and I was unable to reproduce. Could you please confirm what type of change you made to the document? Is it in a collection or a sub-collection?

[MrAlek]

@russellwheatley In this case I just changed one of the string attributes to test the integration. It's in a root-level collection but as you can see the document also has sub-collections.

[MrAlek]

Here's the full log:

[handihow]

same error here..
Just installed this extension but I have the same error when updating documents in the collection

[ThadeuLuz]

Also getting this. Will investigate better tomorrow

[mikekaranja]

I have the exact same issue. Any timelines on when it will be fixed?

[rafaelacb]

I am with this issue too.. I've just installed BigQuery extension on my firebase project and made a test with a bigquery-mirror-test and I've this... Is there any way to solve it quickly?

[humanagent]

You can follow up here
#235

[laurenzlong]

The fix has been published in 0.1.3 of the firestore-bigquery-change-tracker NPM package - which is a dependency for the extension. When we do the next release of the firestore-bigquery-export extension, you'll receive the update. If you want to "force" the dependency update now, you can either:

• uninstall and reinstall the extension
• OR reconfigure the extension to force an update