Installation

Learn how to install RDI ingest

This guide explains how to install RDI and integrate it with your source database.

Install RDI on VMs

You would normally install RDI on two VMs for high availability (HA) but you can also install one just one VM if you don't need this. For example, you might not need HA during development and testing.

The supported OS versions for RDI are:

  • RHEL 8 & 9
  • Ubuntu 18.04 & 20.04

You must run the RDI installer as a privileged user because it installs containerd and registers services. However, you don't need any special privileges to run RDI processes for normal operation.

Hardware sizing

RDI is mainly CPU and network bound. Each of the RDI VMs should have:

  • CPU: A minimum of 4 CPU cores. You should consider adding 2-6 extra cores on top of this if your dataset is big and you want to ingest the baseline snapshot as fast as possible.
  • RAM: 2GB
  • Disk: 25GB of disk (this includes the OS footprint)
  • 10GB or more network interface

Installation steps

Follow the steps below for each of your VMs:

  1. Download the RDI installer from the Redis download center (under the Modules, Tools & Integration dropdown) and extract it to your preferred installation folder.

  2. Go to the installation folder:

    cd rdi_install/$RDI_VERSION

  3. Run the installer as a privileged user:

    sudo ./install.sh

RDI uses a database on your Redis Enterprise cluster to store its state information. This requires Redis Enterprise v6.4 or greater.

The installer will ask you for cluster admin credentials. You should supply these if you want the installer to create the RDI database for you.

Note:
The installer does not create the RDI Redis database with TLS/ mTLS. If you want to use TLS or other advanced options then you must create the Redis database yourself using the Redis Enterprise console.

If you don’t want the installation to create the RDI database for you:

  • Use the Redis console to create a database with 250MB RAM with 1 primary and 1 replica.
  • If you are deploying RDI for a production environment then secure this database with a password and TLS.
  • Provide the installation with the required RDI database details.

Once the installation is finished, RDI is ready for use.

Note:
RDI gives you instructions to help you create secrets and create your pipeline.

"Silent" installation

You can use the installer script or the redis-di install command with the --file option (or the shorter version -f) to supply answers to the installer's questions automatically using properties from a TOML file:

./install.sh --file silent.toml

Silent install example

The following example shows the properties for a typical silent install configuration:

title = "RDI Silent Installer Config"

scaffold = true
deploy_directory = "/opt/rdi/config"

# If you are *not* using an existing RDI database and you want
# the installer to create one then remove the properties in this
# section, apart from :
# - `password`
# - `use_existing_rdi` -  set this to `false`
# Also, uncomment the [rdi.cluster] section below.
[rdi.database]
host = "localhost"
port = 12001
username = "username"
password = "password"
use_existing_rdi = true
ssl = true

# Uncomment this section and remove properties from the
# [rdi.database] section as described above if you
# are *not* using an existing RDI database and you want
# the installer to create one.
# [rdi.cluster]
# host = "localhost"
# port = 9443
# username = "username"
# password = "password"


# Uncomment the properties in this section only if the RDI
# database uses TLS/mTLS.
# [rdi.database.certificates]
# ca = "/home/ubuntu/rdi/certs/ca.crt"
# cert = "/home/ubuntu/rdi/certs/client.crt"
# key = "/home/ubuntu/rdi/certs/client.key"
# passphrase = "foobar"

The sections below describe the properties in more detail.

Silent install properties

Root

Property Description
title Text to identify the file. RDI doesn't use use this, so you can use any text you like.
high_availability Do you want to enable replication on the RDI database (true/false)? You should only use this if you ask the installer to create the RDI database for you.
scaffold Do you want to enable scaffolding during the install? (true/false)
db_index Integer to specify the source database type for scaffolding. The options are 2 (MySQL/MariaDB), 3 (Oracle), 4 (PostgreSQL), and 5 (SQL Server).
deploy_directory Path to the directory where you want to store the RDI configuration.

rdi.database

Use the properties in this section if you want to use an existing RDI database. See rdi.cluster below if you want the installer to create a new RDI database. However, you should still supply the password in this section and set use_existing_rdi to false if the installer creates the database.

Property Description
host Hostname for the Redis database to store RDI state.
port Port for the RDI database.
username Username for the RDI database.
password Password for the RDI database.
use_existing_rdi Do you want to use an existing RDI instance (true) or create a new one (false)? If you enable SSL (see the property below), this will be set to true, overriding the value you specify here.
ssl Is SSL enabled for the RDI database (true/false)? If this is false then RDI will ignore the settings in the rdi.database.certificates section.

rdi.cluster

Use the properties in this section if you are not using an existing RDI database and you want the installer to create one. See rdi.database above if you want to use an existing RDI database.

Property Description
host Hostname of the Redis cluster to use for RDI.
port Port for the cluster.
username Username for the cluster.
password Password for the cluster.

rdi.database.certificates

Use these properties only if the RDI database requires TLS or mTLS. You must also set ssl to true in the rdi.database section to enable these properties.

Property Description
ca Path to the CA certificate file.
cert Path to the client certificate file.
key Path to the key file.
passphrase Password for the private key (string).

Prepare your source database

You must also configure your source database to use the Debezium connector for CDC. See the Prepare source databases section to learn how to do this.

Uninstall RDI

If you want to remove your RDI installation, go to the installation folder and run the uninstall script as a privileged user:

sudo ./uninstall.sh

The script will check you are sure before you proceed:

This will uninstall RDI and its dependencies, are you sure? [y, N]

If you type anything other than "y" here, the script will abort without making any changes to RDI or your source database.

RATE THIS PAGE
Back to top ↑