Marriage of disparate data

Date view Thread view Subject view Author view Attachment view

From: L Lockwood (lockwood_at_uclink.berkeley.edu)
Date: Tue Jun 10 2003 - 16:00:24 PDT

(First time posting. Apologies if this is the wrong list to post to. Is
there a list primarily for developers here at UCB?)

Current system: web-based reports built in ASP querying an Oracle database.
The database is running on HP Tru64 Unix, and the web-based reports are
running on WinNT, soon to migrate to Win2k, if it matters.

Soon, some of this data will be moved from the Oracle database to a system
using flat file storage. The only part of our operation that needs to
continue looking at both Oracle and these new flat files is these online
reports.

Problem: Many of these reports currently *join* Oracle tables to get their
results, but some of the joined tables will soon be moving to flat files.
Can anyone here think of a way to query from tables remaining in Oracle
*and* the data stored in flat files that would approximate a table join?

Both data sources (Oracle and flat files) are accessible through ODBC. Data
Source Names (DSNs) can be set up on the web server so that the ASP pages
can easily query from them separately, but...

Complication 1: These reports are fairly large, in terms of the number of
records they must return. For this reason, querying one data source then
looping through the resulting records to find corresponding data from the
other data source is unlikely to work acceptibly.

Complication 2: Periodic import from the flat files back into Oracle is not
desireable, due to potential problems with duplicate or out-of-synch data.

Any ideas or advice would be much appreciated.

-----------------
Lyman Lockwood
Webmaster, Programmer/Analyst-II
PP-CS Information Systems Group
3-8467

------------------------------------------------------------------------
The following was automatically added to this message by the list server:

For information about Micronet, including subscribing to
or unsubscribing from its mailing list and finding out
about upcoming meetings, please visit the Micronet Web site:
<http://micronet.berkeley.edu/>.

Date view Thread view Subject view Author view Attachment view

This archive was generated by hypermail 2.1.5 : Tue Jun 10 2003 - 16:05:20 PDT