I've always liked webreaper . Maybe it can help you with what your trying to do.