- AutorIn
- Wolfgang Lehner Technische Universität Dresden, Fakultät Informatik, Institut für Systemarchitektur, Professur Datenbanken#Universität Erlangen Nürnberg, IMMD 6
- Christian Thomsen
- Torben Bach Pedersen
- Titel
- RiTE: Providing On-Demand Data for Right-Time Data Warehousing
- Zitierfähige Url:
- https://nbn-resolving.org/urn:nbn:de:bsz:14-qucosa2-796431
- Konferenz
- IEEE 24th International Conference on Data Engineering. Cancun, 07.-12.04.2008
- Quellenangabe
- 2008 IEEE 24th International Conference on Data Engineering. Proceedings
Erscheinungsort: New York, NY
Verlag: Institute of Electrical and Electronics Engineers incorporated (IEEE)
Erscheinungsjahr: 2008
Seiten: 456-465 - Erstveröffentlichung
- 2008
- Abstract (EN)
- Data warehouses (DWs) have traditionally been loaded with data at regular time intervals, e.g., monthly, weekly, or daily, using fast bulk loading techniques. Recently, the trend is to insert all (or only some) new source data very quickly into DWs, called near-realtime DWs (right-time DWs). This is done using regular INSERT statements, resulting in too low insert speeds. There is thus a great need for a solution that makes inserted data available quickly, while still providing bulk-load insert speeds. This paper presents RiTE ('Right-Time ETL'), a middleware system that provides exactly that. A data producer (ETL) can insert data that becomes available to data consumers on demand. RiTE includes an innovative main-memory based catalyst that provides fast storage and offers concurrency control. A number of policies controlling the bulk movement of data based on user requirements for persistency, availability, freshness, etc. are supported. The system works transparently to both producer and consumers. The system is integrated with an open source DBMS, and experiments show that it provides 'the best of both worlds', i.e., INSERT-like data availability, but with bulk-load speeds (up to 10 times faster).
- Andere Ausgabe
- Link zum Artikel, der zuerst in der IEEE Xplore Digital Library erschienen ist:
DOI: 10.1109/ICDE.2008.4497454 - Freie Schlagwörter (DE)
- Warehousing, Datenbanken, Informatik, Middleware, Data Warehouses, Concurrency Control, Feeds, Multidimensionale Systeme, Chemische Prozesse, Verfügbarkeit
- Freie Schlagwörter (EN)
- Warehousing, Databases, Computer science, Middleware, Data warehouses, Concurrency control, Feeds, Multidimensional systems, Chemical processes, Availability
- Klassifikation (DDC)
- 004
- Verlag
- IEEE, New York, NY
- Förder- / Projektangaben
- European Commission (EC)
European Internet accessibility observatory (EIAO)
ID: 004526 - Version / Begutachtungsstatus
- angenommene Version / Postprint / Autorenversion
- URN Qucosa
- urn:nbn:de:bsz:14-qucosa2-796431
- Veröffentlichungsdatum Qucosa
- 20.06.2022
- Dokumenttyp
- Konferenzbeitrag
- Sprache des Dokumentes
- Englisch
- Lizenz / Rechtehinweis