in reply to Retrieve changes in remote dataset

Neither CPAN, not even Perl, probably only for low-change (e.g. configuration) databases Then, there is Sqitch, in CPAN: sqitch, however, that seems to concentrate on database structure, not the data itself.

Disclaimer: I didn't use any of these, just have them on my "explore later" list.

Replies are listed 'Best First'.
Re^2: Retrieve changes in remote dataset
by hippo (Archbishop) on Jul 18, 2017 at 11:31 UTC

    I had considered the possibility of using git (or at least some VCS) fetching the changes, extracting the diff, processing that and then merging. It's a possibility for sure but the work involved might be even more than rolling our own RESTful updater. Thanks for the thought.

    We looked at sqitch for another project a while back. I think it can do data changes OK but it is seriously overkill for this particular task (and the dependency tree is on the heavy side too).

Re^2: Retrieve changes in remote dataset
by 1nickt (Canon) on Jul 18, 2017 at 12:15 UTC

    I seem to remember that we used rsync for this some time in the Jurassic. Worked well with MySQL ISAM tables IIRC.


    The way forward always starts with a minimal test.