in reply to Re^4: Efficient search through a huge dataset
in thread Efficient search through a huge dataset

SQLite doesn't do the full outer join thing, so you have to fake it with two left outer joins :

-- in table2 but not in table1: SELECT r.id FROM table2 AS r LEFT JOIN table1 AS l ON r.id = l.id WHERE r.system = ? and l.id IS NULL and r.id IS NOT NULL -- in table1 but not in table2: SELECT l.id FROM table2 AS l LEFT JOIN table1 AS r ON l.id = r.id WHERE l.system = ? and l.id IS NOT NULL and r.id IS NULL SQL

But other than that, SQLite is up to the task, as it includes a nice bulk import statement (SQLite 2.x) and a bulk loader program (SQLite 3.x).

Update: Added the "full" to "full outer join", as a "left (outer) join" is an outer join too, but one which SQLite does...

Replies are listed 'Best First'.
Re^6: Efficient search through a huge dataset
by dragonchild (Archbishop) on Oct 20, 2004 at 13:28 UTC
    Umm ... Corion? That is an outer join. SQLite just doesn't require the OUTER keyword. :-)

    Being right, does not endow the right to be rude; politeness costs nothing.
    Being unknowing, is not the same as being stupid.
    Expressing a contrary opinion, whether to the individual or the group, is more often a sign of deeper thought than of cantankerous belligerence.
    Do not mistake your goals as the only goals; your opinion as the only opinion; your confidence as correctness. Saying you know better is not the same as explaining you know better.