The best example of what I want to do is SAS JMP software.
It provides a way to directly interact with charts(select ,exclude and export data) and switch back and forth between the charts and the data.
I don't need the complexity JMP provides but the idea is the same.