in reply to Re^2: database and deployment questions
in thread Newbie question

I would still be looking to do all that within an RDBMS.

storing millions of rows and hundreds of columns in 2d array if possible

Sure it's possible - if you have enough memory. I just don't see why you would do that when a database is the right tool for the job. There is nothing you have said here to suggest to me that it isn't.


🦛

  • Comment on Re^3: database and deployment questions

Replies are listed 'Best First'.
Re^4: database and deployment questions
by SpaceCowboy (Acolyte) on Oct 21, 2021 at 18:57 UTC
    so how would one go about joining tables from multiple data sources without database links and without temp tables...

      joining tables from multiple data sources without database links and without temp tables

      Foreign Tables via Foreign Data Wrappers from SQL/MED. SQL/MED is part of the SQL Standard. These wrappers provide access to external data sources.

      SQL/MED on wikipedia

      and without temp tables

      What an odd and arbitrary restriction. Why should that apply?


      🦛

        sorry, on an initial thought, it sounded like setting up yet another database for temporary tables

        thanks to other monks in this thread, I was able to get an overview of temp tables and it is not anyway a standing up another instance

        so yes, I will work on temp tables. obviously, you monks -- @hippo and others are more experienced, if you have any other advice, I will greatly appreciate it...

        What an odd and arbitrary restriction.

        I'm beginning to think hippo, that this is either a wind up or the data is really coming from somewhere other than an RDBMS such as a flat or structured text file.

      so how would one go about joining tables from multiple data sources without database links

      One wouldn't!

      If you have multiple data sources which are in different databases, then you need to link to them somehow. Data cannot flow from one place to another without some form of link...

      and without temp tables...

      Why would you want to???
      The creators of RDBMSs and languages give us the facilities to solve problems. It is up to us to use them in a sensible way. Choosing not to use one or more is a bit like trying to cross a river by paddling when a perfectly good boat is ready and available.

      I know of no modern RDBMS that does not support temporary tables.