Been looking for generic tools to help write data-migrations/crawlers to have runners to mirror data from a GraphQL or REST end-point to local storage to ease integrations with say ERPNext.
My use cases could be to periodically extract data from 3PL warehouses or shipping carriers to a local file or db storage to make custom modules weaving in that data fast and effifient (than fetching on demand from various api’s, especially since FedEx and UPS tend to limit history via their API’s)
Another use-case would be to mirror parts/components/items from PLM-like systems into ERPNext. Making a tailored integration would of course work, but it’s nice to split it up in steps, storing the raw responses from 3rd party API’s, then apply the transformation and filtering before injecting the data in a custom DocType.
Thoughts?