Software

Name

Description

Comment

Centos 7

Operating system

OK

XCAT

Deployment environment

OK

Cloudera Manager

Big Data Deployment

OK

Cloudera HDFS

Hadoop distributed file system

OK

Cloudera Accumulo

Key/value store

OK

Cloudera HBase

Database on top of HDFS

OK

Cloudera Hive

Data warehouse using SQL

OK

Cloudera Hue

Hadoop user experience, web gui, SQL analytics workbench

OK

Cloudera Impala

SQL query engine, used by Hue

OK

Oozie

Oozie is a workflow scheduler system to manage Apache Hadoop jobs. Used by Hue

OK

Cloudera Solr

Open source enterprise search platform, used by Hue, used by Key-Value Store Indexer

OK

Cloudera Key-Value 
Store Indexer

The Key-Value Store Indexer service uses the Lily HBase NRT Indexer to index the stream of records being added to HBase tables. Indexing allows you to query data stored in HBase with the Solr service.

OK

Cloudera Spark (Spark 2)

Cluster-computing framework mit Scala 2.10 (2.11)

OK

Cloudera YARN (MR2 Included)

Yet Another Resource Negotiator (cluster management)

OK

Cloudera ZooKeeper

ZooKeeper is a centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services

OK

Java 1.8

Software Development Kit

OK

Python 2.7, 3.*

Software Development Kit

OK

Scala

Programming language

OK

Anaconda Python (Python)

Programming language with package management from Anaconda

OK

Jupyter Notebook

Webinterface for interactive computing, needs Anaconda

OK

JupyterLab

JupyterLab is the next-generation web-based user interface for Project Jupyter

OK

Cassandra

Requires disk space, selected nodes

TODO

Kafka

Open-source stream-processing software platform, configuration required for specific use

Rollout phase

MongoDB

NoSQL database, selected nodes

Rollout phase

Service Center

Logo service center

© TU Wien

 

Ticketsystem Online Portal, opens an external URL in a new window
Hotline 01 588 01 42002
help@it.tuwien.ac.at
1040 Wien, Operngasse 11, EG

The Service Center can be reached digitally from 8 a.m. to 4 p.m.

Safety and Security Measures, opens an external URL in a new window

 

Personal customer contact only by prior appointment, opens an external URL in a new window.

 

Compliance with the currently applicable COVID-19 security regulations is assumed.