whenmodified does not update when account name is changed

[pnadolny13]

The general ledger details stream is incrementally synced using the whenmodified field but that field does not get updated when some reference data is updated. For example the general ledger accounts table has updates to the account names and the modified date is updated there but in the GL details table that account name is not updated incrementally because the modified date is not updated. Doing a full table sync returns the updated account names so they do get updated but they arent updating the modified date.

[pnadolny13]

cc @edgarrmondragon

One idea is to handle this in the transformation layer which is outside the control of this tap. We can always join in the source of truth table (general ledger accounts in this case) when accessing its metadata. If this is the solution we may want to consider removing metadata fields like this from the general ledger stream so that they arent relied on if they may go stale over time.

[edgarrmondragon]

If this is the solution we may want to consider removing metadata fields like this from the general ledger stream so that they arent relied on if they may go stale over time.

That sounds reasonable to me.

I'm trying to think of how could enable something like via a new feature this from upstream in the SDK, but it's probably too complicated and not as common.